-- Logs begin at Wed 2022-08-10 22:00:13 UTC, end at Wed 2022-08-10 23:19:03 UTC. -- Aug 10 22:39:58.144529 dv-cinder-851449-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 22:39:58.152766 dv-cinder-851449-5-smb devstack@keystone.service[93395]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 22:39:58 2022] *** Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: nodename: dv-cinder-851449-5-smb Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: machine: x86_64 Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: clock source: unix Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: pcre jit disabled Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: detected number of CPU cores: 4 Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: current working directory: / Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: detected binary path: /usr/bin/uwsgi-core Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: your processes number limit is 47680 Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: your memory page size is 4096 bytes Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: detected max file descriptor number: 2048 Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: lock engine: pthread robust mutexes Aug 10 22:39:58.156237 dv-cinder-851449-5-smb devstack@keystone.service[93395]: thunder lock: enabled Aug 10 22:39:58.158849 dv-cinder-851449-5-smb devstack@keystone.service[93395]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 22:39:58.158849 dv-cinder-851449-5-smb devstack@keystone.service[93395]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 22:39:58.195074 dv-cinder-851449-5-smb devstack@keystone.service[93395]: Python main interpreter initialized at 0x5570738e89c0 Aug 10 22:39:58.195074 dv-cinder-851449-5-smb devstack@keystone.service[93395]: python threads support enabled Aug 10 22:39:58.195074 dv-cinder-851449-5-smb devstack@keystone.service[93395]: your server socket listen backlog is limited to 100 connections Aug 10 22:39:58.195074 dv-cinder-851449-5-smb devstack@keystone.service[93395]: your mercy for graceful operations on workers is 90 seconds Aug 10 22:39:58.195462 dv-cinder-851449-5-smb devstack@keystone.service[93395]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 22:39:58.195540 dv-cinder-851449-5-smb devstack@keystone.service[93395]: *** Operational MODE: preforking *** Aug 10 22:39:58.195777 dv-cinder-851449-5-smb devstack@keystone.service[93395]: *** uWSGI is running in multiple interpreter mode *** Aug 10 22:39:58.195777 dv-cinder-851449-5-smb devstack@keystone.service[93395]: spawned uWSGI master process (pid: 93395) Aug 10 22:39:58.195990 dv-cinder-851449-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 10 22:39:58.197325 dv-cinder-851449-5-smb devstack@keystone.service[93395]: spawned uWSGI worker 1 (pid: 93407, cores: 1) Aug 10 22:39:58.197325 dv-cinder-851449-5-smb devstack@keystone.service[93395]: spawned uWSGI worker 2 (pid: 93408, cores: 1) Aug 10 22:39:58.197325 dv-cinder-851449-5-smb devstack@keystone.service[93395]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 22:40:03.699894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:40:03.699894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: from cryptography.utils import int_from_bytes Aug 10 22:40:03.700749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:40:03.700749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: from cryptography.utils import int_from_bytes Aug 10 22:40:03.701179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:40:03.701179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: from cryptography.utils import int_from_bytes Aug 10 22:40:03.701307 dv-cinder-851449-5-smb devstack@keystone.service[93407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:40:03.701307 dv-cinder-851449-5-smb devstack@keystone.service[93407]: from cryptography.utils import int_from_bytes Aug 10 22:40:03.750059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 22:40:03.750252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 22:40:03.750337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 22:40:03.750440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 22:40:03.750523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] command line args: [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 22:40:03.750602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] command line args: [] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 22:40:03.750743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 22:40:03.750834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 22:40:03.750942 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ================================================================================ {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 22:40:03.751037 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ================================================================================ {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 22:40:03.751197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] admin_token = **** {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.751278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] admin_token = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.751443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] config_dir = [] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.751534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] config_dir = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.751632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.751771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.751857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] config_source = [] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.751981 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] config_source = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.752111 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] debug = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.752226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.752421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] debug = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.752421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.752568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.752788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.752880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.752949 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.753013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.753164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.753248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.753438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] list_limit = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.753519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.753586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] log_config_append = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.753764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.753848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.753980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] log_dir = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.754072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_config_append = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.754135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] log_file = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.754275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.754359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.754421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_dir = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.754572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.754676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_file = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.754824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.754918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.755072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.755207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.755300 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.755413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.755531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.755656 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.755817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.755912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.755985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.756117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.756205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.756348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.756471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.756570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.756701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.756801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.756939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.757047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.757237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.757358 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.757558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.757637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.757855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.758049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.758164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.758251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] publish_errors = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.758449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.758525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.758679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.758854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.758982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.759100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.759331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.759440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.759563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] standard_threads = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.759648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] publish_errors = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.759791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.759926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.760016 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.760195 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.760278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.760370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] use_journal = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.760448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.760543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] use_json = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.760715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] use_stderr = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.760798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.760876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] use_syslog = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.761012 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.761099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.761338 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] standard_threads = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.761433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.761607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.761686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.761866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.761996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.762104 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.762257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.762375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] use_journal = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.762462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.762542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] use_json = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.762613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.762736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] use_stderr = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.762827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.762948 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] use_syslog = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.763058 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.763243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:40:03.763321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.763536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.763622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.763783 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.763867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.764017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.764219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.764297 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.764485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.764562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.764737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.764895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.764974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.765207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.765308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.765486 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.765591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.765738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.765911 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.765989 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.766267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.766345 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.766624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.766700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.766957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.767034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.767279 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.767387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.767591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.767740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.767892 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.768046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.768204 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.768365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.768505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.768687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.768803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.769046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.769135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.769410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.769491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.769663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.769767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.769896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.770086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.770170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.770362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.770440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.770612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.770836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.770916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.771087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.771320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.771397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.771555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.771725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.771805 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.771958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.772041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.772186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.772270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.772425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.772511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.772642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.772727 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.772877 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.772953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.773121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.773231 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.773395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.773538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.773645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.773743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.773848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.773957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.774056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.774163 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.774266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.774346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.774518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.774601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.774762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.774873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.774968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.775056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.775204 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.775323 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.775433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.775514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.775662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.775752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.775887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.775976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.776114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.776194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.776347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.776466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.776585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.776676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.776818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.776932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.777046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.777139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.777271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.777395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.777526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.777623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.777760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.777842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.777996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.778097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.778228 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.778315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.779035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.779117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.779278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.779370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.779513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.779606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.779749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.779829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.779985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.780074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.780211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.780305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.780442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.780520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.780681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.780777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.780912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.781001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.781140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.781227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.781403 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.781573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.781659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.781739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.781862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.781941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.782093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.782184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.782324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.782402 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.782556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.782631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.782815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.782912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.783051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.783129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.783290 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.783377 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.783523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.783609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.783753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.783834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.783985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.784065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.784217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.784303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.784450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.784535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.784677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.784755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.784905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.784992 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.785135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.785214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.785395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.785500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.785622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.785706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.785863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.785961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.786100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.786192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.786346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.786445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.786581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.786686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.786817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.786902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.787050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.787130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.787287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.787367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.787519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.787598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] auth.external = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.787744 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.787823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.787975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.788054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.788202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.788280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.788427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.788513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] auth.password = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.788661 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.788743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] auth.token = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.788883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.788962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.789108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.789188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.789362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.789459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.789595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.789674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.789840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.789931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.790072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.790152 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.790303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.790438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.790545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] credential.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.790634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.790795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.790874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.791028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.external = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.791108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.791255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.791336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.791503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.791581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.791748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.791829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.791978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.password = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.792056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.792204 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.token = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.792284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.792438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.792518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.792670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.792753 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.792914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.792994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.793142 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.793224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.793407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.793500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.793652 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.793732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.793880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.793961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.794742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.794834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.794996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.795076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] federation.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.795237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.795316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.795484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.795563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.795719 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.795799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.795947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.796022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.796179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.796260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.796415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.796497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.796670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.796752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.796905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.796991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.797160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.797253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.797422 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.797505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.797670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.797750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.797906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.797999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.798156 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.798236 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.798404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.798483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.798638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.798730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.798872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.798953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.799120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.799200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.799351 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.799439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.799632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.799719 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.799837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.799917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.800070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.800157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.800305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.800383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.800569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.800656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.800755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.800844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.800999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.801122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.801245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.801355 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.801503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.801591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.801753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.801834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.801998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.802077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.802228 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.802315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.802460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.802542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.802706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.802794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.802935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.803024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.803166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.803245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.803399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.803509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.803632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.803728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.803871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.803953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.804108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.804189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.804336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.804425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.804575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.804654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.804820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.804900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.805063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.805152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.805323 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.805409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.805567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.805647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.805825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.805918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.806056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.806137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.806290 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.806368 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.806516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.806596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.806746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.806833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.806974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.807058 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.807203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.807284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.807435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.807515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.807669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.807747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.807913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.807993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.808139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.808218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.808380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.808459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.808609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.808690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.808839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.808918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.809082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.809163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.809343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.809428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.809573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.809653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.809829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.809909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.810056 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.810139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.810291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.810371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.810524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.810605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.810760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.810842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.810999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.811082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.811233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.811319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.811479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.811567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.811711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.811791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.811940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.812021 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.812164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.812253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.812395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.812475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.812630 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.812710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.812859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.812940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.813088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.813167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.813336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.813420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.813568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.813650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.813803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.813883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.814059 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.814138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.814286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.814367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.814528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.814607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.814764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.814843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.814999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.815080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.815229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.815308 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.815460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.815540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.815692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.815773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.815923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.816003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.816155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.816235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.816381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.816464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.816623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.816702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.816865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.816943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.817099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.817179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.817353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.817437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.817593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.817726 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.817870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.818003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.818132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.818271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.818403 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.818535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.818750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.818886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.819016 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.819145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] resource.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.819275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.819415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.819560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.819691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.819832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.819962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.820092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.820222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.820359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.820489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.820620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.820749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.820879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] role.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] role.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.821985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822056 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822357 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.822997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.823162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.823244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.823411 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.823491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.823645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.823724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.823893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.823974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.824141 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.824220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.824374 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] role.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.824454 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.824619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.824699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] role.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.824844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.825046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.825126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.825335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.825439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.825581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.825663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.825833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.825922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.826078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.826216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.826323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.826467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.826569 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.826702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.826814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.826956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.827039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.827208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.827289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.827458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.827544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.827694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.827776 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.827928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.828009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.828160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.828378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.828461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.828612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.828692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.828858 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.828940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.829105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.829187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.829360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.829508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.829589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.829756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.829849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] token.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.829989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.830070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.830244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.830351 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.830494 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.830596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.830731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.830812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.830967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.831094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.831198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.831288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.831427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.831509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.831674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.831755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.831924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.832012 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.832158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.832238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.832392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.832474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.832624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.832713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.832854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.832981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.833087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.833168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.833343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.833440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.833589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.833670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.833822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.833901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.834076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.834166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.connection = **** {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.834323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.834413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.834560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.834640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.834801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.834881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.835040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.835121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.835280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.835360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.835512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.835592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.835745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.835826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.835979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.836079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.836218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.836299 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.836454 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.836537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.836679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.836758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.836918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.836998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.837163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.837243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.837423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.837513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.connection = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.837669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.837833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.837913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.837985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.838127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.838224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.838361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.838455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.838564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 22:40:03.838643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.838834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.839065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.839296 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.839537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.839769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.840008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.840237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.840482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.840713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.841560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.841795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.842033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.842291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:40:03.842429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 22:40:03.868435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.868658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.868877 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.871054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.871287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.871511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.878672 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.881233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.907183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.907420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.907554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.907766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.958893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:03.959289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.009497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.009735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.009904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.010135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.073555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.073809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.073953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.074091 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.074225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.074358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.074499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.074631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.074759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.074887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.075016 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.075712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.098333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.098564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.098764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.098898 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.099042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.099171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.099301 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.099430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.099559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.099687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.099835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.099964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.099964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.100226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.110737 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.111557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.123350 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.123586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.123688 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.123798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.123898 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.124013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.124096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.124222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.124305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.124429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.124528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.124638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.124724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.124917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 22:40:04.142031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.142239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 22:40:04.142449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.142578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.142661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 22:40:04.142776 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 22:40:04.142989 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.143072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.143190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 22:40:04.143272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.143465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.143546 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.143728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.143814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.143990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.144249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.155559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.155837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.156107 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.156191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.156387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.156476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.156660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.156947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.163279 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.163865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.166362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.166632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.166916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.166998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.167199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.167282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.167482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.167573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.167741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.167823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.168006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.168088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.168276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.168367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.168543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.168624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.168812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.168893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.169108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.169246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.169487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.169772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.191848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.192891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.193350 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.193634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.194419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.194721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.198215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.198498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.198779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.199319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.199603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.199886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.205952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.206237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.207013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.207299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.210326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.210616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.210897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.211176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.211329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.211459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.211622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.211760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.211889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.212016 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.212175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.212302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.212438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.212711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.212982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.213253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.228837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.229115 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.229709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.229990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.233131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.233978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.236293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.236589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.237099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.237421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.240971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.241798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.244154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.244956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.247333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.247630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.247925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.248138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.248278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.248443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.248574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.248727 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.248867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.249022 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.249311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.249625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.265200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.265508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.265783 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.266049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.266704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.266994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.267265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.267540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.273112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.274477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.274697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.274974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.276037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.276315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.277782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.278067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.278974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.279268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.279547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.279675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.279947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.280247 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.280538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.280819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.290954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.291233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.291513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.291793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.292074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.292203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.292334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.292464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.292603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.292731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.292995 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.293277 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.293579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.293854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.309353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.310881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.312347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.313863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.315399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.316804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.316953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.318396 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.318489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.318864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.319057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.319901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.320180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.320479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.330827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.330999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.331136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.331270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.331413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.331413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.331413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.331413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.331970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.332262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.332550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.332832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.339398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.339691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.339972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.341398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.341700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.341985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.347439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.347724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.348004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.348276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.348548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.348806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 22:40:04.348890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.349092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.349172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.349398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.349493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.349675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.349780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.349956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.350061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.350232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.350315 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.350509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.350590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.350791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.350881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.351097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.351428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.351699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.351975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.352242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.352551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.352797 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 22:40:04.386563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570738e89c0 pid: 93408 (default app) Aug 10 22:40:04.390148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570738e89c0 pid: 93407 (default app) Aug 10 22:40:04.390685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047afac4-177d-4fb3-a247-bbcca3f9f09e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:04.390969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047afac4-177d-4fb3-a247-bbcca3f9f09e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:04.391237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047afac4-177d-4fb3-a247-bbcca3f9f09e None None] PATH_INFO: `/v3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:04.396213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Wed Aug 10 22:40:04 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:12.872869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc7fdf-deb5-42d7-88ca-c9e5a18eedf8 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:12.873428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc7fdf-deb5-42d7-88ca-c9e5a18eedf8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:12.873428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc7fdf-deb5-42d7-88ca-c9e5a18eedf8 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:12.877794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:40:12.883277 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:12.883671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:12.883808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:12.953629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: INFO dbcounter [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] Registered counter for database keystone Aug 10 22:40:12.974270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG oslo_db.sqlalchemy.engines [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:40:12.981265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writer thread running {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:40:13.168053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG passlib.handlers.bcrypt [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93408) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 22:40:13.168415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG passlib.handlers.bcrypt [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93408) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 22:40:13.223170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:13.224764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:13.357994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 22:40:13.481686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc7fdf-deb5-42d7-88ca-c9e5a18eedf8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:13.550612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: INFO dbcounter [None req-47dc7fdf-deb5-42d7-88ca-c9e5a18eedf8 None None] Registered counter for database keystone Aug 10 22:40:13.569518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG oslo_db.sqlalchemy.engines [None req-47dc7fdf-deb5-42d7-88ca-c9e5a18eedf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:40:13.575694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writer thread running {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:40:13.691548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc7fdf-deb5-42d7-88ca-c9e5a18eedf8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:13.695749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01b221-ea74-49e1-b166-dc7244410e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:13.696361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b221-ea74-49e1-b166-dc7244410e15 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:13.696635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b221-ea74-49e1-b166-dc7244410e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:13.696900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01b221-ea74-49e1-b166-dc7244410e15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:13.704949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01b221-ea74-49e1-b166-dc7244410e15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:13.757442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6a01b221-ea74-49e1-b166-dc7244410e15 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 22:40:13.757717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01b221-ea74-49e1-b166-dc7244410e15 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:13.767992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Wed Aug 10 22:40:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 22:40:13.774033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:13.789130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b02fb1-6c29-4557-bf40-b2d35bd3bb24 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:13.793838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b890c-caa6-4100-8e0d-4bfe430a4703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:13.794952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b890c-caa6-4100-8e0d-4bfe430a4703 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:13.795231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b890c-caa6-4100-8e0d-4bfe430a4703 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:13.795503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b890c-caa6-4100-8e0d-4bfe430a4703 admin admin] PATH_INFO: `/v3/projects/98ff4b51ad344f35909bb4fdee93bcd4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:13.796929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b890c-caa6-4100-8e0d-4bfe430a4703 admin admin] RBAC: Authorizing `identity:get_project(project_id=98ff4b51ad344f35909bb4fdee93bcd4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:13.847774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f05b890c-caa6-4100-8e0d-4bfe430a4703 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 22:40:13.848113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b890c-caa6-4100-8e0d-4bfe430a4703 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:13.853053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Wed Aug 10 22:40:13 2022] GET /identity/v3/projects/98ff4b51ad344f35909bb4fdee93bcd4 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:15.824894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e02a7-8a30-4d71-acbb-bf5229b7f281 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:15.825523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e02a7-8a30-4d71-acbb-bf5229b7f281 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:15.825523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e02a7-8a30-4d71-acbb-bf5229b7f281 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:15.829638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:40:15.835111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcb4f2-cddf-449d-82b7-208eccb04829 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:15.835587 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcb4f2-cddf-449d-82b7-208eccb04829 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:15.835773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcb4f2-cddf-449d-82b7-208eccb04829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:15.858258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-0dfcb4f2-cddf-449d-82b7-208eccb04829 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:15.859785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0dfcb4f2-cddf-449d-82b7-208eccb04829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:15.867614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 22:40:15.889523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e02a7-8a30-4d71-acbb-bf5229b7f281 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:15.902192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e02a7-8a30-4d71-acbb-bf5229b7f281 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:15.906376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6364de-9456-4802-aa1a-0d3296b737eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:15.906967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6364de-9456-4802-aa1a-0d3296b737eb admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:15.907245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6364de-9456-4802-aa1a-0d3296b737eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:15.907515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6364de-9456-4802-aa1a-0d3296b737eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:15.915057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6364de-9456-4802-aa1a-0d3296b737eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:15.916816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6364de-9456-4802-aa1a-0d3296b737eb admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:15.926067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Wed Aug 10 22:40:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 22:40:15.931694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcb4f2-cddf-449d-82b7-208eccb04829 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:15.940634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcb4f2-cddf-449d-82b7-208eccb04829 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:15.944982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bf067-5251-4b9e-bf51-4c5224baff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:15.945624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bf067-5251-4b9e-bf51-4c5224baff87 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:15.945903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bf067-5251-4b9e-bf51-4c5224baff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:15.946173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bf067-5251-4b9e-bf51-4c5224baff87 admin admin] PATH_INFO: `/v3/users/8525de726b7c407fab4fe9cbff320061` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:15.947488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bf067-5251-4b9e-bf51-4c5224baff87 admin admin] RBAC: Authorizing `identity:get_user(user_id=8525de726b7c407fab4fe9cbff320061)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:15.949360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bf067-5251-4b9e-bf51-4c5224baff87 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:15.950889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Wed Aug 10 22:40:15 2022] GET /identity/v3/users/8525de726b7c407fab4fe9cbff320061 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:18.026517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36608c9-0cc0-4523-8474-bbfc53e8bd34 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.027062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36608c9-0cc0-4523-8474-bbfc53e8bd34 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.027062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36608c9-0cc0-4523-8474-bbfc53e8bd34 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.028387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:18.033671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ee65-a1d2-4d5d-9171-08c25da9e069 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.034110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ee65-a1d2-4d5d-9171-08c25da9e069 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.034329 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ee65-a1d2-4d5d-9171-08c25da9e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.051656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cfc2ee65-a1d2-4d5d-9171-08c25da9e069 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:18.052811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cfc2ee65-a1d2-4d5d-9171-08c25da9e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:18.070160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d67c6-bb19-41a6-8e68-32b2e092760f None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.070438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d67c6-bb19-41a6-8e68-32b2e092760f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.070710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d67c6-bb19-41a6-8e68-32b2e092760f None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.071998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:40:18.078171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73ca89-a677-42f4-afd1-b4127588031f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.078457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73ca89-a677-42f4-afd1-b4127588031f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.078724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73ca89-a677-42f4-afd1-b4127588031f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.121700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG passlib.handlers.bcrypt [None req-6d73ca89-a677-42f4-afd1-b4127588031f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93407) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 22:40:18.122137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG passlib.handlers.bcrypt [None req-6d73ca89-a677-42f4-afd1-b4127588031f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93407) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 22:40:18.134513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:18.157316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2ee65-a1d2-4d5d-9171-08c25da9e069 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:18.167648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-6d73ca89-a677-42f4-afd1-b4127588031f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:18.169259 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6d73ca89-a677-42f4-afd1-b4127588031f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:18.180688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:18.263200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2ee65-a1d2-4d5d-9171-08c25da9e069 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:18.269595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:18.291501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73ca89-a677-42f4-afd1-b4127588031f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:18.297088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad6dc7-fa9d-412a-adb0-bd7de1b1ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:18.297770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad6dc7-fa9d-412a-adb0-bd7de1b1ba71 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.298050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad6dc7-fa9d-412a-adb0-bd7de1b1ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.298321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad6dc7-fa9d-412a-adb0-bd7de1b1ba71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.310231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad6dc7-fa9d-412a-adb0-bd7de1b1ba71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-d5ad6dc7-fa9d-412a-adb0-bd7de1b1ba71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:18.319007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:18.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:18.320795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:40:18.325993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad6dc7-fa9d-412a-adb0-bd7de1b1ba71 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:18.396859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73ca89-a677-42f4-afd1-b4127588031f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:18.399969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:18.420239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:18.438780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad6dc7-fa9d-412a-adb0-bd7de1b1ba71 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:18.443795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159519-3524-48f0-8f83-79deaeb98a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:18.444708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159519-3524-48f0-8f83-79deaeb98a07 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.444986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159519-3524-48f0-8f83-79deaeb98a07 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.445255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa159519-3524-48f0-8f83-79deaeb98a07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.473193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84257540-6049-4503-8cd1-c115d1adde0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:18.473874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84257540-6049-4503-8cd1-c115d1adde0f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.474157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84257540-6049-4503-8cd1-c115d1adde0f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.474690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84257540-6049-4503-8cd1-c115d1adde0f None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.475360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84257540-6049-4503-8cd1-c115d1adde0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:18.475659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84257540-6049-4503-8cd1-c115d1adde0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:18.477048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84257540-6049-4503-8cd1-c115d1adde0f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:18.489072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 8/15] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:18.494602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84257540-6049-4503-8cd1-c115d1adde0f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:18.512772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa159519-3524-48f0-8f83-79deaeb98a07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:18.514305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa159519-3524-48f0-8f83-79deaeb98a07 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:18.615597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 8/16] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 22:40:18.622234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159519-3524-48f0-8f83-79deaeb98a07 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:18.625675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:18.707530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84257540-6049-4503-8cd1-c115d1adde0f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:18.726861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa159519-3524-48f0-8f83-79deaeb98a07 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:18.743548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef23d23-32e2-4cfd-9f8d-3e87fc7eb969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:18.744195 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23d23-32e2-4cfd-9f8d-3e87fc7eb969 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.744473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23d23-32e2-4cfd-9f8d-3e87fc7eb969 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.744774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23d23-32e2-4cfd-9f8d-3e87fc7eb969 None admin] PATH_INFO: `/v3/users/8525de726b7c407fab4fe9cbff320061` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.746004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef23d23-32e2-4cfd-9f8d-3e87fc7eb969 None admin] RBAC: Authorizing `identity:get_user(user_id=8525de726b7c407fab4fe9cbff320061)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:18.747471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef23d23-32e2-4cfd-9f8d-3e87fc7eb969 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:18.749040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 9/17] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:18 2022] GET /identity/v3/users/8525de726b7c407fab4fe9cbff320061 => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:18.754401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef23d23-32e2-4cfd-9f8d-3e87fc7eb969 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:18.762088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7a064-1826-44ff-a0b5-d2a4b586fe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:18.762938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a064-1826-44ff-a0b5-d2a4b586fe38 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.763211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a064-1826-44ff-a0b5-d2a4b586fe38 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.763474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7a064-1826-44ff-a0b5-d2a4b586fe38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.769274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:18.782659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7a064-1826-44ff-a0b5-d2a4b586fe38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:18.784132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7a064-1826-44ff-a0b5-d2a4b586fe38 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-42e7a064-1826-44ff-a0b5-d2a4b586fe38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:40:18.803284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:18.804346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:40:18.805148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:40:18.805148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:40:18.805148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:18.805148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 9/18] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:40:18.810322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7a064-1826-44ff-a0b5-d2a4b586fe38 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:18.856972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef23d23-32e2-4cfd-9f8d-3e87fc7eb969 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:18.866949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:18.891828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abab12-9155-4eeb-becb-e8e6bcac79d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:18.892455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abab12-9155-4eeb-becb-e8e6bcac79d4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.892729 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abab12-9155-4eeb-becb-e8e6bcac79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.892988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abab12-9155-4eeb-becb-e8e6bcac79d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.894133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abab12-9155-4eeb-becb-e8e6bcac79d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:18.895576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abab12-9155-4eeb-becb-e8e6bcac79d4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:18.897106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 10/19] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:18.903438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abab12-9155-4eeb-becb-e8e6bcac79d4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:18.918032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7a064-1826-44ff-a0b5-d2a4b586fe38 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:18.950507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa034b28-8e3e-41fb-8e7d-d015f1ffe002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:18.951110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa034b28-8e3e-41fb-8e7d-d015f1ffe002 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:18.951391 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa034b28-8e3e-41fb-8e7d-d015f1ffe002 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:18.951651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa034b28-8e3e-41fb-8e7d-d015f1ffe002 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:18.952286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa034b28-8e3e-41fb-8e7d-d015f1ffe002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:18.952580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa034b28-8e3e-41fb-8e7d-d015f1ffe002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:18.953984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa034b28-8e3e-41fb-8e7d-d015f1ffe002 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:18.971405 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 10/20] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:18.985928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:19.006960 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abab12-9155-4eeb-becb-e8e6bcac79d4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:19.045733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913cc86-944d-48d6-bc35-6cdb91c23aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:19.046381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913cc86-944d-48d6-bc35-6cdb91c23aed None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:19.046616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913cc86-944d-48d6-bc35-6cdb91c23aed None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:19.046882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913cc86-944d-48d6-bc35-6cdb91c23aed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:19.047623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913cc86-944d-48d6-bc35-6cdb91c23aed None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.domain.id=default, user.id=8525de726b7c407fab4fe9cbff320061) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:19.047919 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913cc86-944d-48d6-bc35-6cdb91c23aed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:19.049418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913cc86-944d-48d6-bc35-6cdb91c23aed None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:19.056987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 11/21] 10.222.0.77 () {56 vars in 1322 bytes} [Wed Aug 10 22:40:18 2022] GET /identity/v3/role_assignments?user.id=8525de726b7c407fab4fe9cbff320061&scope.domain.id=default&role.id=edba0d8c079245a38a321d2d77d25419 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:21.410614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa0f0-7ab9-4483-9aec-8af0743f5ce0 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:21.411645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa0f0-7ab9-4483-9aec-8af0743f5ce0 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:21.412146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa0f0-7ab9-4483-9aec-8af0743f5ce0 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:21.413729 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 11/22] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:21.419238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a38af5-d6bf-4966-b8fc-730e3fd0e5de None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:21.420065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a38af5-d6bf-4966-b8fc-730e3fd0e5de None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:21.420539 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a38af5-d6bf-4966-b8fc-730e3fd0e5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:21.446376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-86a38af5-d6bf-4966-b8fc-730e3fd0e5de None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:21.448645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-86a38af5-d6bf-4966-b8fc-730e3fd0e5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:21.509090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada71e-a0dc-434e-bddf-be38e38165dc None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:21.509724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada71e-a0dc-434e-bddf-be38e38165dc None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:21.510775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada71e-a0dc-434e-bddf-be38e38165dc None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:21.512678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 12/23] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:21.519210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593d510-0322-4302-829e-2ad46af19834 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:21.519490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593d510-0322-4302-829e-2ad46af19834 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:21.519768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593d510-0322-4302-829e-2ad46af19834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:21.558402 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9593d510-0322-4302-829e-2ad46af19834 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:21.559592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9593d510-0322-4302-829e-2ad46af19834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:21.570398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 12/24] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:21.573341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04d6d-c4ce-4060-a8eb-fc0f2347d4b0 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:21.573910 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04d6d-c4ce-4060-a8eb-fc0f2347d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:21.574436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b04d6d-c4ce-4060-a8eb-fc0f2347d4b0 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:21.575909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 13/25] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:40:21.584258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437c0d8-a015-4de4-8c61-2155b093f3fa None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:21.584817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437c0d8-a015-4de4-8c61-2155b093f3fa None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:21.585322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437c0d8-a015-4de4-8c61-2155b093f3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:21.613739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7437c0d8-a015-4de4-8c61-2155b093f3fa None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:21.614929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7437c0d8-a015-4de4-8c61-2155b093f3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:21.691228 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 14/26] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:21.692556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437c0d8-a015-4de4-8c61-2155b093f3fa None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:21.696605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:21.733958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 13/27] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:21.747133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593d510-0322-4302-829e-2ad46af19834 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:21.825663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:21.886393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593d510-0322-4302-829e-2ad46af19834 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:21.898454 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437c0d8-a015-4de4-8c61-2155b093f3fa None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:21.925110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2d91d-494e-46f9-aa92-b0000aecf0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:21.926093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2d91d-494e-46f9-aa92-b0000aecf0f4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:21.926632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2d91d-494e-46f9-aa92-b0000aecf0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:21.927089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2d91d-494e-46f9-aa92-b0000aecf0f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:21.940501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2d91d-494e-46f9-aa92-b0000aecf0f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-8ec2d91d-494e-46f9-aa92-b0000aecf0f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:21.946882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:21.948242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:21.948971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:21.951279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 14/28] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:21.952238 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2d91d-494e-46f9-aa92-b0000aecf0f4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:21.995133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c74a3e-b1c6-4db6-94f0-aefddf8091d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:21.995781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c74a3e-b1c6-4db6-94f0-aefddf8091d9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:21.996061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c74a3e-b1c6-4db6-94f0-aefddf8091d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:21.996333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c74a3e-b1c6-4db6-94f0-aefddf8091d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:22.026421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c74a3e-b1c6-4db6-94f0-aefddf8091d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:22.027916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c74a3e-b1c6-4db6-94f0-aefddf8091d9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-20c74a3e-b1c6-4db6-94f0-aefddf8091d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:40:22.059881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:22.060789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:40:22.061617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:40:22.061617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:40:22.061617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:22.063569 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 15/29] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:22.064731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c74a3e-b1c6-4db6-94f0-aefddf8091d9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:22.143713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:22.192833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c74a3e-b1c6-4db6-94f0-aefddf8091d9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:22.199474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2d91d-494e-46f9-aa92-b0000aecf0f4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:22.207362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:22.230167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed136e57-44d8-4082-810c-ee3a787b05c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:22.231017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed136e57-44d8-4082-810c-ee3a787b05c7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:22.231441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed136e57-44d8-4082-810c-ee3a787b05c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:22.231879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed136e57-44d8-4082-810c-ee3a787b05c7 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:22.232686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed136e57-44d8-4082-810c-ee3a787b05c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:22.233146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed136e57-44d8-4082-810c-ee3a787b05c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:22.234813 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed136e57-44d8-4082-810c-ee3a787b05c7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:22.239205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88466eae-8b97-490d-8f7c-3b86a632d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:22.239811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466eae-8b97-490d-8f7c-3b86a632d09f None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:22.240081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466eae-8b97-490d-8f7c-3b86a632d09f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:22.240347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466eae-8b97-490d-8f7c-3b86a632d09f None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:22.241098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88466eae-8b97-490d-8f7c-3b86a632d09f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:22.242647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88466eae-8b97-490d-8f7c-3b86a632d09f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:22.244911 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 16/30] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:22.246172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd43c7-d616-4718-b736-6b209e105b65 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:22.246626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd43c7-d616-4718-b736-6b209e105b65 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:22.247050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd43c7-d616-4718-b736-6b209e105b65 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:22.248425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 17/31] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:22.249268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd43c7-d616-4718-b736-6b209e105b65 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:22.366136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd43c7-d616-4718-b736-6b209e105b65 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:22.388574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:22.412326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673a7e9-46c5-47bd-8379-5c93552b8d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:22.413276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673a7e9-46c5-47bd-8379-5c93552b8d82 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:22.413759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673a7e9-46c5-47bd-8379-5c93552b8d82 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:22.414502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673a7e9-46c5-47bd-8379-5c93552b8d82 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:22.415692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673a7e9-46c5-47bd-8379-5c93552b8d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:22.416896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673a7e9-46c5-47bd-8379-5c93552b8d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:22.418746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673a7e9-46c5-47bd-8379-5c93552b8d82 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:22.441269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 18/32] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:22.442935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673a7e9-46c5-47bd-8379-5c93552b8d82 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:22.474977 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 15/33] 10.222.0.77 () {60 vars in 1131 bytes} [Wed Aug 10 22:40:21 2022] POST /identity/v3/roles => generated 219 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:22.474977 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e22e47-f110-4aff-9b36-0a54c77d4df2 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:22.474977 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e22e47-f110-4aff-9b36-0a54c77d4df2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:22.474977 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e22e47-f110-4aff-9b36-0a54c77d4df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:22.491570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-78e22e47-f110-4aff-9b36-0a54c77d4df2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:22.494490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-78e22e47-f110-4aff-9b36-0a54c77d4df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:22.584879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673a7e9-46c5-47bd-8379-5c93552b8d82 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:22.632341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedfba5-64d7-4b4f-98a2-d6d44f646892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:22.633725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedfba5-64d7-4b4f-98a2-d6d44f646892 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:22.635570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedfba5-64d7-4b4f-98a2-d6d44f646892 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:22.636101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedfba5-64d7-4b4f-98a2-d6d44f646892 None admin] PATH_INFO: `/v3/users/8525de726b7c407fab4fe9cbff320061` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:22.638441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedfba5-64d7-4b4f-98a2-d6d44f646892 None admin] RBAC: Authorizing `identity:get_user(user_id=8525de726b7c407fab4fe9cbff320061)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:22.640919 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedfba5-64d7-4b4f-98a2-d6d44f646892 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:22.644323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 19/34] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:22 2022] GET /identity/v3/users/8525de726b7c407fab4fe9cbff320061 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:22.646277 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedfba5-64d7-4b4f-98a2-d6d44f646892 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:22.647845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 16/35] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:22.655502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e22e47-f110-4aff-9b36-0a54c77d4df2 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:22.717026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:22.789180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:22.792806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedfba5-64d7-4b4f-98a2-d6d44f646892 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:22.796144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e22e47-f110-4aff-9b36-0a54c77d4df2 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:22.830802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46744adf-9ed0-4673-a43a-fc646de57cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:22.831022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4158cd-fbd3-4ce0-a9a0-d9af9880c504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:22.831438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46744adf-9ed0-4673-a43a-fc646de57cc1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:22.831555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4158cd-fbd3-4ce0-a9a0-d9af9880c504 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:22.831737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46744adf-9ed0-4673-a43a-fc646de57cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:22.831830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4158cd-fbd3-4ce0-a9a0-d9af9880c504 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:22.832006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46744adf-9ed0-4673-a43a-fc646de57cc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:22.832096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4158cd-fbd3-4ce0-a9a0-d9af9880c504 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:22.832665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4158cd-fbd3-4ce0-a9a0-d9af9880c504 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:22.833383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46744adf-9ed0-4673-a43a-fc646de57cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:22.834129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4158cd-fbd3-4ce0-a9a0-d9af9880c504 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:22.834926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46744adf-9ed0-4673-a43a-fc646de57cc1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:22.836480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 17/36] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:22.837220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46744adf-9ed0-4673-a43a-fc646de57cc1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:22.939220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46744adf-9ed0-4673-a43a-fc646de57cc1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:22.974415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84016c71-e5ed-4993-87d2-7fae80c10aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:22.975035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84016c71-e5ed-4993-87d2-7fae80c10aed None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:22.975313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84016c71-e5ed-4993-87d2-7fae80c10aed None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:22.975585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84016c71-e5ed-4993-87d2-7fae80c10aed None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:22.976252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84016c71-e5ed-4993-87d2-7fae80c10aed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:22.977640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84016c71-e5ed-4993-87d2-7fae80c10aed None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:23.049338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 18/37] 10.222.0.77 () {60 vars in 1131 bytes} [Wed Aug 10 22:40:22 2022] POST /identity/v3/roles => generated 225 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:23.050618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4289-3b43-4dfd-bf8c-d8504b3bc1b7 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:23.050902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4289-3b43-4dfd-bf8c-d8504b3bc1b7 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:23.051174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4289-3b43-4dfd-bf8c-d8504b3bc1b7 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:23.053904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 19/38] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:23.053904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa4289-3b43-4dfd-bf8c-d8504b3bc1b7 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:23.063711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 20/39] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:40:22 2022] POST /identity/v3/projects => generated 301 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:23.067095 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf5e7c-c04c-49fc-9780-d984fe08d94b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:23.067385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf5e7c-c04c-49fc-9780-d984fe08d94b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:23.067663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf5e7c-c04c-49fc-9780-d984fe08d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:23.111734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8cbf5e7c-c04c-49fc-9780-d984fe08d94b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:23.115452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8cbf5e7c-c04c-49fc-9780-d984fe08d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:23.119996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:23.208529 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 21/40] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:23.209951 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c982a-04df-4a22-ab37-e665fd4e7ac9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:23.210260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c982a-04df-4a22-ab37-e665fd4e7ac9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:23.210537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c982a-04df-4a22-ab37-e665fd4e7ac9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:23.212039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 22/41] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:23.217578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05f3b-06f8-4597-98dc-15946240a1da None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:23.217868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05f3b-06f8-4597-98dc-15946240a1da None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:23.218151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05f3b-06f8-4597-98dc-15946240a1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:23.226860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa4289-3b43-4dfd-bf8c-d8504b3bc1b7 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:23.237545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-30b05f3b-06f8-4597-98dc-15946240a1da None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:23.238770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-30b05f3b-06f8-4597-98dc-15946240a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:23.267623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:23.274006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594a8ae-9628-4744-ba6e-ace837a2f344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:23.275033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594a8ae-9628-4744-ba6e-ace837a2f344 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:23.275488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594a8ae-9628-4744-ba6e-ace837a2f344 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:23.276036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594a8ae-9628-4744-ba6e-ace837a2f344 None admin] PATH_INFO: `/v3/domains/default/users/8525de726b7c407fab4fe9cbff320061/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:23.283462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594a8ae-9628-4744-ba6e-ace837a2f344 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8525de726b7c407fab4fe9cbff320061, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:23.284939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594a8ae-9628-4744-ba6e-ace837a2f344 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:23.329450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 23/42] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:23.330238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b05f3b-06f8-4597-98dc-15946240a1da None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:23.413908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 20/43] 10.222.0.77 () {58 vars in 1361 bytes} [Wed Aug 10 22:40:23 2022] PUT /identity/v3/domains/default/users/8525de726b7c407fab4fe9cbff320061/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:40:23.414740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594a8ae-9628-4744-ba6e-ace837a2f344 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:23.434248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b05f3b-06f8-4597-98dc-15946240a1da None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:23.476431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86047754-784f-46c5-81c1-df4b08eade72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:23.477217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86047754-784f-46c5-81c1-df4b08eade72 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:23.477632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86047754-784f-46c5-81c1-df4b08eade72 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:23.477996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86047754-784f-46c5-81c1-df4b08eade72 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:23.479220 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86047754-784f-46c5-81c1-df4b08eade72 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:23.480769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86047754-784f-46c5-81c1-df4b08eade72 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:23.529197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:23.541610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 24/44] 10.222.0.77 () {60 vars in 1131 bytes} [Wed Aug 10 22:40:23 2022] POST /identity/v3/roles => generated 223 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:23.560992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594a8ae-9628-4744-ba6e-ace837a2f344 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:23.603056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8ff11-188a-41b9-a265-dee4c368e1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:23.603260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8ff11-188a-41b9-a265-dee4c368e1ff None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:23.603904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8ff11-188a-41b9-a265-dee4c368e1ff None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:23.604158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8ff11-188a-41b9-a265-dee4c368e1ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:23.605384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8ff11-188a-41b9-a265-dee4c368e1ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:23.607009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8ff11-188a-41b9-a265-dee4c368e1ff None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:23.608472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 21/45] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:23.615287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86047754-784f-46c5-81c1-df4b08eade72 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:23.639671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:23.735201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86047754-784f-46c5-81c1-df4b08eade72 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:23.772644 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f32d4d-dbfe-456f-a19a-d58fb86c37c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:23.773256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32d4d-dbfe-456f-a19a-d58fb86c37c8 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:23.773561 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32d4d-dbfe-456f-a19a-d58fb86c37c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:23.773827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32d4d-dbfe-456f-a19a-d58fb86c37c8 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:23.774474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f32d4d-dbfe-456f-a19a-d58fb86c37c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:23.775948 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f32d4d-dbfe-456f-a19a-d58fb86c37c8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:23.856518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 25/46] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:40:23 2022] POST /identity/v3/projects => generated 312 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:25.441432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8833d4-bc5b-4b64-bb97-b5b1cbeb737f None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:25.441952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8833d4-bc5b-4b64-bb97-b5b1cbeb737f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:25.441952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8833d4-bc5b-4b64-bb97-b5b1cbeb737f None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:25.443300 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 22/47] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:25.448471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1917fa-333e-4ebb-8f39-d42c00697111 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:25.448888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1917fa-333e-4ebb-8f39-d42c00697111 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:25.449030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1917fa-333e-4ebb-8f39-d42c00697111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:25.467383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8e1917fa-333e-4ebb-8f39-d42c00697111 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:25.468554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8e1917fa-333e-4ebb-8f39-d42c00697111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:25.530153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:25.534619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 26/48] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:25.557838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8833d4-bc5b-4b64-bb97-b5b1cbeb737f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:25.658948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8833d4-bc5b-4b64-bb97-b5b1cbeb737f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:25.691874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5f083-6f40-4c16-8285-c08b2a9b0072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:25.692412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5f083-6f40-4c16-8285-c08b2a9b0072 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:25.692688 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5f083-6f40-4c16-8285-c08b2a9b0072 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:25.692952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5f083-6f40-4c16-8285-c08b2a9b0072 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:25.702955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5f083-6f40-4c16-8285-c08b2a9b0072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-acf5f083-6f40-4c16-8285-c08b2a9b0072 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:25.707637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:25.708691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:25.709648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 23/49] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:25.716886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1917fa-333e-4ebb-8f39-d42c00697111 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:25.814343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1917fa-333e-4ebb-8f39-d42c00697111 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:25.849528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8124d-d6f9-43d4-9059-aed0bdd6d371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:25.850142 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8124d-d6f9-43d4-9059-aed0bdd6d371 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:25.850423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8124d-d6f9-43d4-9059-aed0bdd6d371 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:25.850696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8124d-d6f9-43d4-9059-aed0bdd6d371 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:25.851363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8124d-d6f9-43d4-9059-aed0bdd6d371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:25.851666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8124d-d6f9-43d4-9059-aed0bdd6d371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:25.853057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8124d-d6f9-43d4-9059-aed0bdd6d371 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:25.862023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 27/50] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:25.867412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5f083-6f40-4c16-8285-c08b2a9b0072 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:25.872178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609a2a3-021d-4f02-a2b1-e76fb0841a24 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:25.872459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609a2a3-021d-4f02-a2b1-e76fb0841a24 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:25.872731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609a2a3-021d-4f02-a2b1-e76fb0841a24 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:25.874077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 28/51] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:25.878913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29a7a0-5b59-4984-a537-48a57e857710 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:25.879195 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29a7a0-5b59-4984-a537-48a57e857710 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:25.879467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29a7a0-5b59-4984-a537-48a57e857710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:25.883141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:25.898753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6b29a7a0-5b59-4984-a537-48a57e857710 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:25.900508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6b29a7a0-5b59-4984-a537-48a57e857710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:25.956817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:25.967871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 29/52] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:25.972451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5f083-6f40-4c16-8285-c08b2a9b0072 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:25.991070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29a7a0-5b59-4984-a537-48a57e857710 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:26.007372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9ac35-e566-4504-9c4e-cd4d1550748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:26.008007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9ac35-e566-4504-9c4e-cd4d1550748e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:26.008283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9ac35-e566-4504-9c4e-cd4d1550748e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:26.008557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9ac35-e566-4504-9c4e-cd4d1550748e None admin] PATH_INFO: `/v3/users/8525de726b7c407fab4fe9cbff320061` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:26.010208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9ac35-e566-4504-9c4e-cd4d1550748e None admin] RBAC: Authorizing `identity:get_user(user_id=8525de726b7c407fab4fe9cbff320061)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:26.011660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9ac35-e566-4504-9c4e-cd4d1550748e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:26.013229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 24/53] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:25 2022] GET /identity/v3/users/8525de726b7c407fab4fe9cbff320061 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:26.018582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9ac35-e566-4504-9c4e-cd4d1550748e None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:26.089850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29a7a0-5b59-4984-a537-48a57e857710 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:26.099924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:26.118080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9ac35-e566-4504-9c4e-cd4d1550748e None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:26.123756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b7ef-8837-4cae-b04e-87cc2dbbf41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:26.124383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b7ef-8837-4cae-b04e-87cc2dbbf41b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:26.124658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b7ef-8837-4cae-b04e-87cc2dbbf41b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:26.124963 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7b7ef-8837-4cae-b04e-87cc2dbbf41b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:26.126063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7b7ef-8837-4cae-b04e-87cc2dbbf41b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:26.127510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7b7ef-8837-4cae-b04e-87cc2dbbf41b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:26.129101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 30/54] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:26.135466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b7ef-8837-4cae-b04e-87cc2dbbf41b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:26.153338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49e737-ca6f-45e1-b3a1-455965c2f721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:26.153975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49e737-ca6f-45e1-b3a1-455965c2f721 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:26.154252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49e737-ca6f-45e1-b3a1-455965c2f721 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:26.154523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49e737-ca6f-45e1-b3a1-455965c2f721 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:26.155634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49e737-ca6f-45e1-b3a1-455965c2f721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:26.157056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49e737-ca6f-45e1-b3a1-455965c2f721 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:26.158653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 25/55] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:26.164478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49e737-ca6f-45e1-b3a1-455965c2f721 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:26.193983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:26.234603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7b7ef-8837-4cae-b04e-87cc2dbbf41b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:26.263478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49e737-ca6f-45e1-b3a1-455965c2f721 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:26.268737 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51820102-9cd5-4779-9a3b-fc3b4581231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:26.269355 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820102-9cd5-4779-9a3b-fc3b4581231a None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:26.269641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820102-9cd5-4779-9a3b-fc3b4581231a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:26.269914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820102-9cd5-4779-9a3b-fc3b4581231a None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:26.270550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51820102-9cd5-4779-9a3b-fc3b4581231a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:26.272005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51820102-9cd5-4779-9a3b-fc3b4581231a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:26.296885 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014f383-583a-40ec-a825-1529a5528b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:26.299591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f383-583a-40ec-a825-1529a5528b25 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:26.299591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f383-583a-40ec-a825-1529a5528b25 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:26.299591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f383-583a-40ec-a825-1529a5528b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:26.299591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014f383-583a-40ec-a825-1529a5528b25 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.domain.id=default, user.id=8525de726b7c407fab4fe9cbff320061) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:26.299591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014f383-583a-40ec-a825-1529a5528b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:26.300508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014f383-583a-40ec-a825-1529a5528b25 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:26.308828 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 26/56] 10.222.0.77 () {56 vars in 1322 bytes} [Wed Aug 10 22:40:26 2022] GET /identity/v3/role_assignments?user.id=8525de726b7c407fab4fe9cbff320061&scope.domain.id=default&role.id=edba0d8c079245a38a321d2d77d25419 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:26.342082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 31/57] 10.222.0.77 () {60 vars in 1140 bytes} [Wed Aug 10 22:40:26 2022] POST /identity/v3/projects => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:40:28.375634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44902b5e-b9ca-431c-a5bd-3ba01f0c2b56 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:28.376143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44902b5e-b9ca-431c-a5bd-3ba01f0c2b56 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:28.376227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44902b5e-b9ca-431c-a5bd-3ba01f0c2b56 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:28.377562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 27/58] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:28.382848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d2a9a-f8c0-402d-b8bd-f2eb3a1248db None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:28.383261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d2a9a-f8c0-402d-b8bd-f2eb3a1248db None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:28.383392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d2a9a-f8c0-402d-b8bd-f2eb3a1248db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:28.402042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c19d2a9a-f8c0-402d-b8bd-f2eb3a1248db None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:28.403207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c19d2a9a-f8c0-402d-b8bd-f2eb3a1248db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:28.467542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 32/59] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:28.492164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44902b5e-b9ca-431c-a5bd-3ba01f0c2b56 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:28.506906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:28.591419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44902b5e-b9ca-431c-a5bd-3ba01f0c2b56 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:28.623823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb0fc5-9d45-4868-b7f2-3a0e3e696c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:28.624435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0fc5-9d45-4868-b7f2-3a0e3e696c4b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:28.624709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0fc5-9d45-4868-b7f2-3a0e3e696c4b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:28.624974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0fc5-9d45-4868-b7f2-3a0e3e696c4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:28.626141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb0fc5-9d45-4868-b7f2-3a0e3e696c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:28.627521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb0fc5-9d45-4868-b7f2-3a0e3e696c4b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:28.629049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 28/60] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:28.634677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d2a9a-f8c0-402d-b8bd-f2eb3a1248db None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:28.676198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:28.732958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d2a9a-f8c0-402d-b8bd-f2eb3a1248db None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:28.765379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac548c7-737e-4d6a-b671-b24e3437897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:28.765973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac548c7-737e-4d6a-b671-b24e3437897f None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:28.766251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac548c7-737e-4d6a-b671-b24e3437897f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:28.766521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac548c7-737e-4d6a-b671-b24e3437897f None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:28.767157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac548c7-737e-4d6a-b671-b24e3437897f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:28.768606 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac548c7-737e-4d6a-b671-b24e3437897f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:28.847724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 33/61] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:40:28 2022] POST /identity/v3/users => generated 275 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:31.937129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e81a8f-7d7c-4000-941d-0c3cded1686c None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:31.937657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e81a8f-7d7c-4000-941d-0c3cded1686c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:31.937657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e81a8f-7d7c-4000-941d-0c3cded1686c None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:31.939203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 29/62] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:31.944167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906f470-1d7e-42ca-a864-9c2caeb8fde8 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:31.944969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906f470-1d7e-42ca-a864-9c2caeb8fde8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:31.945531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906f470-1d7e-42ca-a864-9c2caeb8fde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:31.973609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3906f470-1d7e-42ca-a864-9c2caeb8fde8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:31.975155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3906f470-1d7e-42ca-a864-9c2caeb8fde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:32.056795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b875132-0cae-4549-98b5-92770a65e5b5 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.057522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b875132-0cae-4549-98b5-92770a65e5b5 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.058027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b875132-0cae-4549-98b5-92770a65e5b5 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.059803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 30/63] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:32.063511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 34/64] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:32.064957 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a020-ccf1-47d7-8a3e-d7e9d8af79bd None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.065483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a020-ccf1-47d7-8a3e-d7e9d8af79bd None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.065947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4a020-ccf1-47d7-8a3e-d7e9d8af79bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.085193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906f470-1d7e-42ca-a864-9c2caeb8fde8 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:32.095368 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e1a4a020-ccf1-47d7-8a3e-d7e9d8af79bd None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:32.096974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e1a4a020-ccf1-47d7-8a3e-d7e9d8af79bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:32.118836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:32.208324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 31/65] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:32.247595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906f470-1d7e-42ca-a864-9c2caeb8fde8 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:32.264760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4a020-ccf1-47d7-8a3e-d7e9d8af79bd None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:32.277698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:32.334723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903a765-e4da-4149-893b-6299976a61b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:32.335554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903a765-e4da-4149-893b-6299976a61b4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.335842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903a765-e4da-4149-893b-6299976a61b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.336114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903a765-e4da-4149-893b-6299976a61b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.366073 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903a765-e4da-4149-893b-6299976a61b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-0903a765-e4da-4149-893b-6299976a61b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:32.379436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:32.380314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:32.381053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:32.381657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 35/66] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:40:32.383004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1d199-75ae-4d35-85da-c702ceff3165 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.383859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1d199-75ae-4d35-85da-c702ceff3165 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.384138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1d199-75ae-4d35-85da-c702ceff3165 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.385427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 36/67] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:32.387185 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1d199-75ae-4d35-85da-c702ceff3165 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:32.408454 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4a020-ccf1-47d7-8a3e-d7e9d8af79bd None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:32.446293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef5003-cc5c-4833-8a8f-bb0e111a05e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:32.447285 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef5003-cc5c-4833-8a8f-bb0e111a05e8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.447771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef5003-cc5c-4833-8a8f-bb0e111a05e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.448203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef5003-cc5c-4833-8a8f-bb0e111a05e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.459409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef5003-cc5c-4833-8a8f-bb0e111a05e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5bef5003-cc5c-4833-8a8f-bb0e111a05e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:32.464563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:32.465438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:32.466158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:32.468421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 32/68] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:40:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:40:32.471245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d325599-2952-4853-a32d-8c503fd64bd5 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.471823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d325599-2952-4853-a32d-8c503fd64bd5 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.472265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d325599-2952-4853-a32d-8c503fd64bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.483285 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:32.493520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-3d325599-2952-4853-a32d-8c503fd64bd5 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:32.495040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3d325599-2952-4853-a32d-8c503fd64bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:32.497640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1d199-75ae-4d35-85da-c702ceff3165 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:32.534692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16712e2a-e06c-41fb-a1fc-086094072626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:32.535298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16712e2a-e06c-41fb-a1fc-086094072626 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.535731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16712e2a-e06c-41fb-a1fc-086094072626 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.536156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16712e2a-e06c-41fb-a1fc-086094072626 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.536967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16712e2a-e06c-41fb-a1fc-086094072626 None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:32.537458 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16712e2a-e06c-41fb-a1fc-086094072626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:32.538990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16712e2a-e06c-41fb-a1fc-086094072626 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:32.553132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 37/69] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:32.554397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16712e2a-e06c-41fb-a1fc-086094072626 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:32.569114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:32.573882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 33/70] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:32.585661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d325599-2952-4853-a32d-8c503fd64bd5 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:32.662228 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16712e2a-e06c-41fb-a1fc-086094072626 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:32.693974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d325599-2952-4853-a32d-8c503fd64bd5 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:32.696732 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a57e7-1a1b-44d8-b4f9-2abcb939796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:32.697474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a57e7-1a1b-44d8-b4f9-2abcb939796c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.697756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a57e7-1a1b-44d8-b4f9-2abcb939796c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.698029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a57e7-1a1b-44d8-b4f9-2abcb939796c None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.698808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a57e7-1a1b-44d8-b4f9-2abcb939796c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:32.699114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a57e7-1a1b-44d8-b4f9-2abcb939796c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:32.700582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a57e7-1a1b-44d8-b4f9-2abcb939796c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:32.709777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 38/71] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:32.710521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a57e7-1a1b-44d8-b4f9-2abcb939796c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:32.725268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:32.729258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c482-c9b9-4b72-9c49-895d7daa60f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:32.729924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c482-c9b9-4b72-9c49-895d7daa60f2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.730202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c482-c9b9-4b72-9c49-895d7daa60f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.730475 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c482-c9b9-4b72-9c49-895d7daa60f2 None admin] PATH_INFO: `/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.746330 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393c482-c9b9-4b72-9c49-895d7daa60f2 None admin] RBAC: Authorizing `identity:get_user(user_id=3dd759a8e1e24b9baa56f4a701f83e0a)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:32.747779 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393c482-c9b9-4b72-9c49-895d7daa60f2 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:32.749442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 34/72] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:32 2022] GET /identity/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:32.754258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069841-ae76-498c-8ee7-b79a95b234b7 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.754258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069841-ae76-498c-8ee7-b79a95b234b7 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.754258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069841-ae76-498c-8ee7-b79a95b234b7 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.754258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 35/73] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:32.754258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4d3a-8174-40e6-92e9-b51d456335e4 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.754258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4d3a-8174-40e6-92e9-b51d456335e4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.754679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4d3a-8174-40e6-92e9-b51d456335e4 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.755166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 36/74] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:32.755672 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c4d3a-8174-40e6-92e9-b51d456335e4 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:32.816706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:32.816903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a57e7-1a1b-44d8-b4f9-2abcb939796c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:32.850234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc3e3c-95a8-4c36-8ea9-db7dd67fc088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:32.850855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc3e3c-95a8-4c36-8ea9-db7dd67fc088 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.851132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc3e3c-95a8-4c36-8ea9-db7dd67fc088 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.851406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc3e3c-95a8-4c36-8ea9-db7dd67fc088 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.858848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c4d3a-8174-40e6-92e9-b51d456335e4 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:32.862086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc3e3c-95a8-4c36-8ea9-db7dd67fc088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-cbdc3e3c-95a8-4c36-8ea9-db7dd67fc088 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:32.867245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:32.868702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:32.869508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 39/75] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:40:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:32.870118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc3e3c-95a8-4c36-8ea9-db7dd67fc088 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:32.895085 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c30816-1f22-4423-a9bf-ce58a7e2afcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:32.895682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30816-1f22-4423-a9bf-ce58a7e2afcc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.895959 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30816-1f22-4423-a9bf-ce58a7e2afcc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.896226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30816-1f22-4423-a9bf-ce58a7e2afcc None admin] PATH_INFO: `/v3/users/8525de726b7c407fab4fe9cbff320061` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.897370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c30816-1f22-4423-a9bf-ce58a7e2afcc None admin] RBAC: Authorizing `identity:get_user(user_id=8525de726b7c407fab4fe9cbff320061)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:32.899325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c30816-1f22-4423-a9bf-ce58a7e2afcc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:32.901067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 37/76] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:32 2022] GET /identity/v3/users/8525de726b7c407fab4fe9cbff320061 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:32.901986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25345-67ad-4a2b-9199-2ee2dea140ee None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.902262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25345-67ad-4a2b-9199-2ee2dea140ee None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.902529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25345-67ad-4a2b-9199-2ee2dea140ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:32.919882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-d5c25345-67ad-4a2b-9199-2ee2dea140ee None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:32.921069 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d5c25345-67ad-4a2b-9199-2ee2dea140ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:32.941070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:32.971213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc3e3c-95a8-4c36-8ea9-db7dd67fc088 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:32.988347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 38/77] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:32.990580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1ca7-2766-4c5c-b321-98920f5b2d7f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:32.991044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1ca7-2766-4c5c-b321-98920f5b2d7f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:32.991319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1ca7-2766-4c5c-b321-98920f5b2d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.007006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5f08c-7cc7-419c-9988-6c9e6c5a7b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.007664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5f08c-7cc7-419c-9988-6c9e6c5a7b70 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.007893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5f08c-7cc7-419c-9988-6c9e6c5a7b70 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.008164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5f08c-7cc7-419c-9988-6c9e6c5a7b70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.012478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f2de1ca7-2766-4c5c-b321-98920f5b2d7f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:33.013722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f2de1ca7-2766-4c5c-b321-98920f5b2d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:33.064035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:33.075240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5f08c-7cc7-419c-9988-6c9e6c5a7b70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:33.076799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5f08c-7cc7-419c-9988-6c9e6c5a7b70 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:33.079463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 39/78] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:33.080287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de1ca7-2766-4c5c-b321-98920f5b2d7f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:33.149547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:33.180164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 40/79] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:33.181004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5f08c-7cc7-419c-9988-6c9e6c5a7b70 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:33.181309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de1ca7-2766-4c5c-b321-98920f5b2d7f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:33.222584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d3eff-5035-4eb5-9f0d-0e471d55ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.223372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d3eff-5035-4eb5-9f0d-0e471d55ba0c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.223661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d3eff-5035-4eb5-9f0d-0e471d55ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.223932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d3eff-5035-4eb5-9f0d-0e471d55ba0c None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.224594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d3eff-5035-4eb5-9f0d-0e471d55ba0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:33.224889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d3eff-5035-4eb5-9f0d-0e471d55ba0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:33.226300 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d3eff-5035-4eb5-9f0d-0e471d55ba0c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:33.238515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 40/80] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:40:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:33.239349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d3eff-5035-4eb5-9f0d-0e471d55ba0c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:33.284644 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5f08c-7cc7-419c-9988-6c9e6c5a7b70 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:33.288702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:33.317682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f24ab-21dd-4509-a3cd-806dac39df24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.318291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f24ab-21dd-4509-a3cd-806dac39df24 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.318568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f24ab-21dd-4509-a3cd-806dac39df24 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.318836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f24ab-21dd-4509-a3cd-806dac39df24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.340600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d3eff-5035-4eb5-9f0d-0e471d55ba0c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:33.361365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:33.373640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0c5f6-b010-4c03-98b2-115767526953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.374301 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c5f6-b010-4c03-98b2-115767526953 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.374577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c5f6-b010-4c03-98b2-115767526953 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.374845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c5f6-b010-4c03-98b2-115767526953 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.386162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0c5f6-b010-4c03-98b2-115767526953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:33.389848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f24ab-21dd-4509-a3cd-806dac39df24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:33.391339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f24ab-21dd-4509-a3cd-806dac39df24 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-e6d0c5f6-b010-4c03-98b2-115767526953 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:33.391507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:33.392472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 41/81] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:33.399343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0c5f6-b010-4c03-98b2-115767526953 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:33.491508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 41/82] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:33.492271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f24ab-21dd-4509-a3cd-806dac39df24 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:33.498288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0c5f6-b010-4c03-98b2-115767526953 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:33.507772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:33.533057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e21de8-892d-4807-8ad3-f91daa11e822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.533707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21de8-892d-4807-8ad3-f91daa11e822 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.533985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21de8-892d-4807-8ad3-f91daa11e822 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.534300 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e21de8-892d-4807-8ad3-f91daa11e822 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.535428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e21de8-892d-4807-8ad3-f91daa11e822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:33.536882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e21de8-892d-4807-8ad3-f91daa11e822 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:33.538845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 42/83] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:33.539548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e21de8-892d-4807-8ad3-f91daa11e822 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:33.565920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:33.597391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f24ab-21dd-4509-a3cd-806dac39df24 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:33.630408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f8f5d-2652-4b89-8732-dcf4b7f428f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.631031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8f5d-2652-4b89-8732-dcf4b7f428f2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.631307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8f5d-2652-4b89-8732-dcf4b7f428f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.631579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f8f5d-2652-4b89-8732-dcf4b7f428f2 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.632689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f8f5d-2652-4b89-8732-dcf4b7f428f2 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:33.634789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f8f5d-2652-4b89-8732-dcf4b7f428f2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:33.636446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 42/84] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:33 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:33.637212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f8f5d-2652-4b89-8732-dcf4b7f428f2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:33.645478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e21de8-892d-4807-8ad3-f91daa11e822 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:33.678677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b87c5-35d2-49d9-910c-6e03fac51cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.679303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b87c5-35d2-49d9-910c-6e03fac51cde None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.679577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b87c5-35d2-49d9-910c-6e03fac51cde None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.680401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b87c5-35d2-49d9-910c-6e03fac51cde None admin] PATH_INFO: `/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.681578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b87c5-35d2-49d9-910c-6e03fac51cde None admin] RBAC: Authorizing `identity:get_user(user_id=3dd759a8e1e24b9baa56f4a701f83e0a)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:33.683016 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b87c5-35d2-49d9-910c-6e03fac51cde None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:33.684749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 43/85] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:33 2022] GET /identity/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:33.685316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b87c5-35d2-49d9-910c-6e03fac51cde None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:33.734479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:33.737920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f8f5d-2652-4b89-8732-dcf4b7f428f2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:33.771987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5532a-a893-4036-948b-b37e848d1d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.772513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5532a-a893-4036-948b-b37e848d1d85 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.772785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5532a-a893-4036-948b-b37e848d1d85 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.773055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5532a-a893-4036-948b-b37e848d1d85 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.773784 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5532a-a893-4036-948b-b37e848d1d85 None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:33.774084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5532a-a893-4036-948b-b37e848d1d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:33.775445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5532a-a893-4036-948b-b37e848d1d85 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:33.783542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 43/86] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:33.784320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5532a-a893-4036-948b-b37e848d1d85 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:33.787144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:33.791673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b87c5-35d2-49d9-910c-6e03fac51cde None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:33.835099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331b26-7e13-47ed-833f-ad376788608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.835740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331b26-7e13-47ed-833f-ad376788608f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.836014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331b26-7e13-47ed-833f-ad376788608f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.836357 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3331b26-7e13-47ed-833f-ad376788608f None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.837509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3331b26-7e13-47ed-833f-ad376788608f None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:33.838958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3331b26-7e13-47ed-833f-ad376788608f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:33.840595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 44/87] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:33 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:33.842169 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331b26-7e13-47ed-833f-ad376788608f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:33.885794 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5532a-a893-4036-948b-b37e848d1d85 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:33.918776 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1c9a-d5df-4018-8ea3-372b4e2bb3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.919378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1c9a-d5df-4018-8ea3-372b4e2bb3ed None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.919659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1c9a-d5df-4018-8ea3-372b4e2bb3ed None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.919925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede1c9a-d5df-4018-8ea3-372b4e2bb3ed None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.920559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede1c9a-d5df-4018-8ea3-372b4e2bb3ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:33.922050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede1c9a-d5df-4018-8ea3-372b4e2bb3ed None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:33.941815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3331b26-7e13-47ed-833f-ad376788608f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:33.954687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:33.974632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dd4c7-d67c-410a-9313-8cb2b9f001cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:33.975229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dd4c7-d67c-410a-9313-8cb2b9f001cd None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:33.975507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dd4c7-d67c-410a-9313-8cb2b9f001cd None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:33.975776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dd4c7-d67c-410a-9313-8cb2b9f001cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:33.976501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dd4c7-d67c-410a-9313-8cb2b9f001cd None admin] RBAC: Adding query filter params (role.id=ec8d0b12e5324b00bca50fea232c8690, scope.project.id=c3806275c2874038ad80b383d2238272, user.id=3dd759a8e1e24b9baa56f4a701f83e0a) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:33.977370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dd4c7-d67c-410a-9313-8cb2b9f001cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:33.978815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dd4c7-d67c-410a-9313-8cb2b9f001cd None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:33.983908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 45/88] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:33 2022] GET /identity/v3/role_assignments?user.id=3dd759a8e1e24b9baa56f4a701f83e0a&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:33.984674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dd4c7-d67c-410a-9313-8cb2b9f001cd None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:34.019853 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 44/89] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:40:33 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:34.020721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1c9a-d5df-4018-8ea3-372b4e2bb3ed None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:34.110123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:34.124385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dd4c7-d67c-410a-9313-8cb2b9f001cd None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:34.171690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede1c9a-d5df-4018-8ea3-372b4e2bb3ed None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:34.174003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df868-f241-4178-80a5-e8abeca929b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:34.175600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df868-f241-4178-80a5-e8abeca929b7 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:34.175847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df868-f241-4178-80a5-e8abeca929b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:34.176118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631df868-f241-4178-80a5-e8abeca929b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:34.213027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d569d8d-98c0-41dd-9069-027d63d6855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:34.213793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d569d8d-98c0-41dd-9069-027d63d6855f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:34.214072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d569d8d-98c0-41dd-9069-027d63d6855f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:34.214342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d569d8d-98c0-41dd-9069-027d63d6855f None admin] PATH_INFO: `/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:34.215575 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d569d8d-98c0-41dd-9069-027d63d6855f None admin] RBAC: Authorizing `identity:get_user(user_id=3dd759a8e1e24b9baa56f4a701f83e0a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:34.217240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d569d8d-98c0-41dd-9069-027d63d6855f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:34.219150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 45/90] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:34 2022] GET /identity/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:34.224651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d569d8d-98c0-41dd-9069-027d63d6855f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:34.233248 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:34.262968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631df868-f241-4178-80a5-e8abeca929b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:34.264449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631df868-f241-4178-80a5-e8abeca929b7 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:34.360954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d569d8d-98c0-41dd-9069-027d63d6855f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:34.400840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:34.406091 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 46/91] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:34.407207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df868-f241-4178-80a5-e8abeca929b7 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:34.416903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e654a6-aac6-4120-95ae-dbb55476c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:34.417582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e654a6-aac6-4120-95ae-dbb55476c033 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:34.417864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e654a6-aac6-4120-95ae-dbb55476c033 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:34.418140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e654a6-aac6-4120-95ae-dbb55476c033 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:34.419564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e654a6-aac6-4120-95ae-dbb55476c033 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=c3806275c2874038ad80b383d2238272, user.id=8525de726b7c407fab4fe9cbff320061) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:34.419875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e654a6-aac6-4120-95ae-dbb55476c033 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:34.421513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e654a6-aac6-4120-95ae-dbb55476c033 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:34.428561 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 46/92] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:34 2022] GET /identity/v3/role_assignments?user.id=8525de726b7c407fab4fe9cbff320061&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=edba0d8c079245a38a321d2d77d25419 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:34.430331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e654a6-aac6-4120-95ae-dbb55476c033 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:34.524849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:34.560922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631df868-f241-4178-80a5-e8abeca929b7 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:34.579673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e654a6-aac6-4120-95ae-dbb55476c033 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:34.609869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304df06-6084-40d3-b2f8-920d3c85bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:34.610585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304df06-6084-40d3-b2f8-920d3c85bd5d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:34.611314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304df06-6084-40d3-b2f8-920d3c85bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:34.611609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304df06-6084-40d3-b2f8-920d3c85bd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:34.624685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9abe7c-a52a-493e-8d72-ec07111f647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:34.625628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9abe7c-a52a-493e-8d72-ec07111f647a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:34.626052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9abe7c-a52a-493e-8d72-ec07111f647a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:34.626466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9abe7c-a52a-493e-8d72-ec07111f647a None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:34.628371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9abe7c-a52a-493e-8d72-ec07111f647a None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:34.630721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9abe7c-a52a-493e-8d72-ec07111f647a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:34.634211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 47/93] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:34 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:34.640782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9abe7c-a52a-493e-8d72-ec07111f647a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:34.696149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304df06-6084-40d3-b2f8-920d3c85bd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:34.698092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304df06-6084-40d3-b2f8-920d3c85bd5d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:34.706859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:34.754109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9abe7c-a52a-493e-8d72-ec07111f647a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:34.782480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:34.792027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97404fa-7100-40ca-ac94-b6636e0c0c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:34.792918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97404fa-7100-40ca-ac94-b6636e0c0c98 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:34.793420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97404fa-7100-40ca-ac94-b6636e0c0c98 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:34.793867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97404fa-7100-40ca-ac94-b6636e0c0c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:34.794767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97404fa-7100-40ca-ac94-b6636e0c0c98 None admin] RBAC: Adding query filter params (role.id=6654493feb544c46aeca606d309a1af2, scope.project.id=c3806275c2874038ad80b383d2238272, user.id=3dd759a8e1e24b9baa56f4a701f83e0a) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:34.795245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97404fa-7100-40ca-ac94-b6636e0c0c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:34.796866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97404fa-7100-40ca-ac94-b6636e0c0c98 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:34.802929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 48/94] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:34 2022] GET /identity/v3/role_assignments?user.id=3dd759a8e1e24b9baa56f4a701f83e0a&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=6654493feb544c46aeca606d309a1af2 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:34.810426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 47/95] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:34.818555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97404fa-7100-40ca-ac94-b6636e0c0c98 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:34.954553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97404fa-7100-40ca-ac94-b6636e0c0c98 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:34.980341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:34.993365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc68e2-f46d-4225-ac2d-5d7732d27df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:34.998049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc68e2-f46d-4225-ac2d-5d7732d27df1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:34.998049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc68e2-f46d-4225-ac2d-5d7732d27df1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:34.998049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc68e2-f46d-4225-ac2d-5d7732d27df1 None admin] PATH_INFO: `/v3/projects/f2b6d06068e74febb5c8467820a5cd7e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:34.998049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc68e2-f46d-4225-ac2d-5d7732d27df1 None admin] RBAC: Authorizing `identity:get_project(project_id=f2b6d06068e74febb5c8467820a5cd7e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:34.998049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc68e2-f46d-4225-ac2d-5d7732d27df1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:34.998866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 49/96] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:34 2022] GET /identity/v3/projects/f2b6d06068e74febb5c8467820a5cd7e => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:35.004953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304df06-6084-40d3-b2f8-920d3c85bd5d None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:35.126448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304df06-6084-40d3-b2f8-920d3c85bd5d None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:35.176075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1e48d-cf29-447b-9450-9f0c1c5c41cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:35.176699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1e48d-cf29-447b-9450-9f0c1c5c41cc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:35.176979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1e48d-cf29-447b-9450-9f0c1c5c41cc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:35.177247 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1e48d-cf29-447b-9450-9f0c1c5c41cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:35.178012 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1e48d-cf29-447b-9450-9f0c1c5c41cc None admin] RBAC: Adding query filter params (role.id=ec8d0b12e5324b00bca50fea232c8690, scope.project.id=f2b6d06068e74febb5c8467820a5cd7e, user.id=3dd759a8e1e24b9baa56f4a701f83e0a) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:35.178319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1e48d-cf29-447b-9450-9f0c1c5c41cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:35.179955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1e48d-cf29-447b-9450-9f0c1c5c41cc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:35.191649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 48/97] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:35 2022] GET /identity/v3/role_assignments?user.id=3dd759a8e1e24b9baa56f4a701f83e0a&scope.project.id=f2b6d06068e74febb5c8467820a5cd7e&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:37.262335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9e9b3-5f34-4164-aecd-6851d4576f68 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.263339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9e9b3-5f34-4164-aecd-6851d4576f68 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.263844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9e9b3-5f34-4164-aecd-6851d4576f68 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.265983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 50/98] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:37.271975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafb705-8ca0-4e48-8de3-d2a77730072b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.272882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafb705-8ca0-4e48-8de3-d2a77730072b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.274003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafb705-8ca0-4e48-8de3-d2a77730072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.286009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a23a9-300a-40dc-a35e-cb3e129a94b2 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.286591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a23a9-300a-40dc-a35e-cb3e129a94b2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.287101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a23a9-300a-40dc-a35e-cb3e129a94b2 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.288858 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 51/99] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:40:37.298345 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7bafb705-8ca0-4e48-8de3-d2a77730072b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:37.307272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7bafb705-8ca0-4e48-8de3-d2a77730072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:37.307385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c45a4-209c-4cfd-8fca-de9ffe1c99b0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.307385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c45a4-209c-4cfd-8fca-de9ffe1c99b0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.307385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c45a4-209c-4cfd-8fca-de9ffe1c99b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.331534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-361c45a4-209c-4cfd-8fca-de9ffe1c99b0 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:37.332980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-361c45a4-209c-4cfd-8fca-de9ffe1c99b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:37.381646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:37.447071 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 49/100] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:37.448421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be6a9a-32b5-49cc-a207-8a0d8400fccc None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.454036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be6a9a-32b5-49cc-a207-8a0d8400fccc None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.454328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be6a9a-32b5-49cc-a207-8a0d8400fccc None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.455800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 50/101] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:37.466894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cd460-c14d-49cf-98c8-ef3190c24a8b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.467179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cd460-c14d-49cf-98c8-ef3190c24a8b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.467450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cd460-c14d-49cf-98c8-ef3190c24a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.471653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 52/102] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:37.494494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-157cd460-c14d-49cf-98c8-ef3190c24a8b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:37.495667 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-157cd460-c14d-49cf-98c8-ef3190c24a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:37.500880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c45a4-209c-4cfd-8fca-de9ffe1c99b0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:37.611448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 51/103] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:37.612999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cd460-c14d-49cf-98c8-ef3190c24a8b None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:37.663875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c45a4-209c-4cfd-8fca-de9ffe1c99b0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:37.690248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:37.711497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558a8a1-0ff4-4527-9450-119d4a338305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:37.712214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558a8a1-0ff4-4527-9450-119d4a338305 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.712501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558a8a1-0ff4-4527-9450-119d4a338305 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.712780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558a8a1-0ff4-4527-9450-119d4a338305 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.728988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558a8a1-0ff4-4527-9450-119d4a338305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-2558a8a1-0ff4-4527-9450-119d4a338305 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:37.735087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:37.735946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:37.736682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 53/104] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:37.741323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1452e65-2dd5-4d7c-8cee-4d49b531815d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.742866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1452e65-2dd5-4d7c-8cee-4d49b531815d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.743155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1452e65-2dd5-4d7c-8cee-4d49b531815d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.744601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 54/105] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:37.746483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1452e65-2dd5-4d7c-8cee-4d49b531815d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:37.760723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:37.764965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cd460-c14d-49cf-98c8-ef3190c24a8b None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:37.813768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a70561-2755-4f4e-ab01-e255df29246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:37.815210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a70561-2755-4f4e-ab01-e255df29246e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.815726 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a70561-2755-4f4e-ab01-e255df29246e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.816150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a70561-2755-4f4e-ab01-e255df29246e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.831171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a70561-2755-4f4e-ab01-e255df29246e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-02a70561-2755-4f4e-ab01-e255df29246e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:37.837686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:37.838754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:37.839737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:37.841962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 52/106] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:37.843254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a70561-2755-4f4e-ab01-e255df29246e None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:37.864694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1452e65-2dd5-4d7c-8cee-4d49b531815d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:37.903300 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8531f6c-2871-4a7b-968a-2a9d7ae64a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:37.903931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531f6c-2871-4a7b-968a-2a9d7ae64a19 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.904209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531f6c-2871-4a7b-968a-2a9d7ae64a19 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.904483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8531f6c-2871-4a7b-968a-2a9d7ae64a19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.905617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8531f6c-2871-4a7b-968a-2a9d7ae64a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:37.907074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8531f6c-2871-4a7b-968a-2a9d7ae64a19 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:37.913108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 55/107] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:37.913108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f32a96-7b5f-4eb9-9f9d-585c232829f8 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:37.913108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f32a96-7b5f-4eb9-9f9d-585c232829f8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:37.913108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f32a96-7b5f-4eb9-9f9d-585c232829f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:37.928847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-63f32a96-7b5f-4eb9-9f9d-585c232829f8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:37.930708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-63f32a96-7b5f-4eb9-9f9d-585c232829f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:37.966874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a70561-2755-4f4e-ab01-e255df29246e None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:37.977107 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:38.003623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ecad0-bc97-40e3-a2ab-4b6c57d4a933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:38.004238 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ecad0-bc97-40e3-a2ab-4b6c57d4a933 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.004511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ecad0-bc97-40e3-a2ab-4b6c57d4a933 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.004782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ecad0-bc97-40e3-a2ab-4b6c57d4a933 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.005575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ecad0-bc97-40e3-a2ab-4b6c57d4a933 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:38.005782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ecad0-bc97-40e3-a2ab-4b6c57d4a933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:38.007149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ecad0-bc97-40e3-a2ab-4b6c57d4a933 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:38.016072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 53/108] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:38.016206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 56/109] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:38.025459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ecad0-bc97-40e3-a2ab-4b6c57d4a933 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:38.025622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff0291-43a0-4414-8e98-6b2dd9a605e2 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.025622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff0291-43a0-4414-8e98-6b2dd9a605e2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.025622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff0291-43a0-4414-8e98-6b2dd9a605e2 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.025622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 57/110] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:38.025622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff0291-43a0-4414-8e98-6b2dd9a605e2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:38.051229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:38.125390 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ecad0-bc97-40e3-a2ab-4b6c57d4a933 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:38.128513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff0291-43a0-4414-8e98-6b2dd9a605e2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:38.161164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c0d12-ed36-42c5-9fb9-627d1aa24fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:38.161716 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c0d12-ed36-42c5-9fb9-627d1aa24fd3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.161996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c0d12-ed36-42c5-9fb9-627d1aa24fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.162270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c0d12-ed36-42c5-9fb9-627d1aa24fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.162976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13234a2e-cc66-43a1-bff3-5697c0ee03d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:38.163088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c0d12-ed36-42c5-9fb9-627d1aa24fd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:38.163357 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c0d12-ed36-42c5-9fb9-627d1aa24fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:38.164187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13234a2e-cc66-43a1-bff3-5697c0ee03d4 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.164457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13234a2e-cc66-43a1-bff3-5697c0ee03d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.164728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13234a2e-cc66-43a1-bff3-5697c0ee03d4 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.165270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c0d12-ed36-42c5-9fb9-627d1aa24fd3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:38.165388 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13234a2e-cc66-43a1-bff3-5697c0ee03d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:38.166814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13234a2e-cc66-43a1-bff3-5697c0ee03d4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:38.173990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 54/111] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:38.174797 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c0d12-ed36-42c5-9fb9-627d1aa24fd3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:38.252864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 58/112] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:40:38 2022] POST /identity/v3/projects => generated 302 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:38.254412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61416-3c17-47cb-bce3-bd1b06d03d35 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.254699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61416-3c17-47cb-bce3-bd1b06d03d35 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.254969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61416-3c17-47cb-bce3-bd1b06d03d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.263421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:38.281350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c0d12-ed36-42c5-9fb9-627d1aa24fd3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:38.287084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c8e61416-3c17-47cb-bce3-bd1b06d03d35 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:38.289614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c8e61416-3c17-47cb-bce3-bd1b06d03d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:38.321032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:38.322465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8140-3e66-4cf6-93f6-e7e79f9f3a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:38.323179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8140-3e66-4cf6-93f6-e7e79f9f3a04 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.323460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8140-3e66-4cf6-93f6-e7e79f9f3a04 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.323758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8140-3e66-4cf6-93f6-e7e79f9f3a04 None admin] PATH_INFO: `/v3/users/3a6ac8b61a2d4f57ac2fc15e54eaedc1` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.339357 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8140-3e66-4cf6-93f6-e7e79f9f3a04 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6ac8b61a2d4f57ac2fc15e54eaedc1)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:38.340859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8140-3e66-4cf6-93f6-e7e79f9f3a04 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:38.347568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 55/113] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:38 2022] GET /identity/v3/users/3a6ac8b61a2d4f57ac2fc15e54eaedc1 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:38.347568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8140-3e66-4cf6-93f6-e7e79f9f3a04 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:38.376690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 59/114] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:38.378363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c608-7c29-47aa-ad7a-84e50fb16284 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.378850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c608-7c29-47aa-ad7a-84e50fb16284 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.379310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c608-7c29-47aa-ad7a-84e50fb16284 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.380800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 60/115] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:38.381748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62c608-7c29-47aa-ad7a-84e50fb16284 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:38.467072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8140-3e66-4cf6-93f6-e7e79f9f3a04 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:38.503494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099f8df-780e-4d3c-bdc5-d2347fb2ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:38.503689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62c608-7c29-47aa-ad7a-84e50fb16284 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:38.504133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099f8df-780e-4d3c-bdc5-d2347fb2ac22 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.504415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099f8df-780e-4d3c-bdc5-d2347fb2ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.504691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099f8df-780e-4d3c-bdc5-d2347fb2ac22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.517066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099f8df-780e-4d3c-bdc5-d2347fb2ac22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-c099f8df-780e-4d3c-bdc5-d2347fb2ac22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:38.522347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:38.523985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 56/116] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:40:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:38.529469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099f8df-780e-4d3c-bdc5-d2347fb2ac22 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:38.533375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:38.553960 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96d1ae-230f-439a-bb6f-ceac88a0c61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:38.554586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d1ae-230f-439a-bb6f-ceac88a0c61d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.554995 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d1ae-230f-439a-bb6f-ceac88a0c61d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.555126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96d1ae-230f-439a-bb6f-ceac88a0c61d None admin] PATH_INFO: `/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.556359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96d1ae-230f-439a-bb6f-ceac88a0c61d None admin] RBAC: Authorizing `identity:get_user(user_id=3dd759a8e1e24b9baa56f4a701f83e0a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:38.558024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96d1ae-230f-439a-bb6f-ceac88a0c61d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:38.559731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 61/117] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:38 2022] GET /identity/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:38.560920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41444-2797-4b5a-b4ea-62d3ed991544 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.561046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41444-2797-4b5a-b4ea-62d3ed991544 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.561214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41444-2797-4b5a-b4ea-62d3ed991544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.582851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-38c41444-2797-4b5a-b4ea-62d3ed991544 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:38.584244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-38c41444-2797-4b5a-b4ea-62d3ed991544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:38.610874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:38.636512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099f8df-780e-4d3c-bdc5-d2347fb2ac22 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:38.658935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 62/118] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:38.659784 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41444-2797-4b5a-b4ea-62d3ed991544 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:38.682100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27612c2c-3fbc-4f5f-8ab9-f35256081e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:38.682720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612c2c-3fbc-4f5f-8ab9-f35256081e09 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.682999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612c2c-3fbc-4f5f-8ab9-f35256081e09 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.683333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27612c2c-3fbc-4f5f-8ab9-f35256081e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.758609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27612c2c-3fbc-4f5f-8ab9-f35256081e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:38.760052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27612c2c-3fbc-4f5f-8ab9-f35256081e09 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:38.762032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:38.775304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41444-2797-4b5a-b4ea-62d3ed991544 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:38.812849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c559d6-2040-4e70-a73e-06da55a609e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:38.813525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c559d6-2040-4e70-a73e-06da55a609e8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.813799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c559d6-2040-4e70-a73e-06da55a609e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.814070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c559d6-2040-4e70-a73e-06da55a609e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.825221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c559d6-2040-4e70-a73e-06da55a609e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-52c559d6-2040-4e70-a73e-06da55a609e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:38.830496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:38.831342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:38.832396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 63/119] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:40:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:38.833270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c559d6-2040-4e70-a73e-06da55a609e8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:38.855031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:38.872496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 57/120] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:38.873381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27612c2c-3fbc-4f5f-8ab9-f35256081e09 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:38.942675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c559d6-2040-4e70-a73e-06da55a609e8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:38.981149 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8659987-3849-4de8-bfb4-fd57daefb212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:38.981788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8659987-3849-4de8-bfb4-fd57daefb212 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:38.982067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8659987-3849-4de8-bfb4-fd57daefb212 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:38.982322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27612c2c-3fbc-4f5f-8ab9-f35256081e09 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:38.982419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8659987-3849-4de8-bfb4-fd57daefb212 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:38.982989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8659987-3849-4de8-bfb4-fd57daefb212 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:38.983289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8659987-3849-4de8-bfb4-fd57daefb212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:38.984074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:38.984678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8659987-3849-4de8-bfb4-fd57daefb212 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:38.994431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 64/121] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:38.995042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8659987-3849-4de8-bfb4-fd57daefb212 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.025745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54842e03-de38-4b3f-a634-b6cce0880f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.026386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54842e03-de38-4b3f-a634-b6cce0880f50 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.026661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54842e03-de38-4b3f-a634-b6cce0880f50 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.026933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54842e03-de38-4b3f-a634-b6cce0880f50 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.028160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54842e03-de38-4b3f-a634-b6cce0880f50 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:39.029512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54842e03-de38-4b3f-a634-b6cce0880f50 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:39.031852 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 58/122] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:38 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:39.031988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54842e03-de38-4b3f-a634-b6cce0880f50 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.087013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:39.106771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8659987-3849-4de8-bfb4-fd57daefb212 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:39.138357 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54842e03-de38-4b3f-a634-b6cce0880f50 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:39.142634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0a4f8-26f1-4b81-8464-a9bb328edc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.143285 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0a4f8-26f1-4b81-8464-a9bb328edc40 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.143538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0a4f8-26f1-4b81-8464-a9bb328edc40 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.143810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0a4f8-26f1-4b81-8464-a9bb328edc40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.154461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0a4f8-26f1-4b81-8464-a9bb328edc40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-c4a0a4f8-26f1-4b81-8464-a9bb328edc40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:39.159662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:39.160510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 65/123] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:39.161283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0a4f8-26f1-4b81-8464-a9bb328edc40 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.180241 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839ac1d-0fda-445f-9966-35f155c804b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.180889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ac1d-0fda-445f-9966-35f155c804b2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.181129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ac1d-0fda-445f-9966-35f155c804b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.181441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ac1d-0fda-445f-9966-35f155c804b2 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.182103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839ac1d-0fda-445f-9966-35f155c804b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:39.182406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839ac1d-0fda-445f-9966-35f155c804b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:39.183769 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839ac1d-0fda-445f-9966-35f155c804b2 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:39.200956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 59/124] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:40:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:39.200956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839ac1d-0fda-445f-9966-35f155c804b2 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.237155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:39.282024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0a4f8-26f1-4b81-8464-a9bb328edc40 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:39.318759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4691f5c-5a0d-4dba-a2a7-539f32c7c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.319394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4691f5c-5a0d-4dba-a2a7-539f32c7c65a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.319702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4691f5c-5a0d-4dba-a2a7-539f32c7c65a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.320000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4691f5c-5a0d-4dba-a2a7-539f32c7c65a None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.321117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4691f5c-5a0d-4dba-a2a7-539f32c7c65a None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:39.322582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4691f5c-5a0d-4dba-a2a7-539f32c7c65a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:39.323407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839ac1d-0fda-445f-9966-35f155c804b2 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:39.324370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 66/125] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:39 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:39.325027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4691f5c-5a0d-4dba-a2a7-539f32c7c65a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.338326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:39.364668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea63aed-41fb-4e00-85b7-6ed2cfb26fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.365840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea63aed-41fb-4e00-85b7-6ed2cfb26fec None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.366123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea63aed-41fb-4e00-85b7-6ed2cfb26fec None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.366395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea63aed-41fb-4e00-85b7-6ed2cfb26fec None admin] PATH_INFO: `/v3/users/8525de726b7c407fab4fe9cbff320061` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.368161 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea63aed-41fb-4e00-85b7-6ed2cfb26fec None admin] RBAC: Authorizing `identity:get_user(user_id=8525de726b7c407fab4fe9cbff320061)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:39.369651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea63aed-41fb-4e00-85b7-6ed2cfb26fec None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:39.371438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 60/126] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:39 2022] GET /identity/v3/users/8525de726b7c407fab4fe9cbff320061 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:39.372007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea63aed-41fb-4e00-85b7-6ed2cfb26fec None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.444478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4691f5c-5a0d-4dba-a2a7-539f32c7c65a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:39.480987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:39.481172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a08ca-6659-49dd-bdd3-6e279bf50062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.481759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a08ca-6659-49dd-bdd3-6e279bf50062 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.482176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a08ca-6659-49dd-bdd3-6e279bf50062 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.482305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a08ca-6659-49dd-bdd3-6e279bf50062 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272/users/3dd759a8e1e24b9baa56f4a701f83e0a/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.484253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a08ca-6659-49dd-bdd3-6e279bf50062 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3806275c2874038ad80b383d2238272, user_id=3dd759a8e1e24b9baa56f4a701f83e0a, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:39.485312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea63aed-41fb-4e00-85b7-6ed2cfb26fec None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:39.485754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a08ca-6659-49dd-bdd3-6e279bf50062 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:39.519576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf03a25-41f7-4976-8e32-1a7f293be7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.520183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf03a25-41f7-4976-8e32-1a7f293be7da None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.520463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf03a25-41f7-4976-8e32-1a7f293be7da None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.520736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf03a25-41f7-4976-8e32-1a7f293be7da None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.521434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf03a25-41f7-4976-8e32-1a7f293be7da None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:39.521737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf03a25-41f7-4976-8e32-1a7f293be7da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:39.523121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf03a25-41f7-4976-8e32-1a7f293be7da None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:39.531083 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 61/127] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:39.531875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf03a25-41f7-4976-8e32-1a7f293be7da None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.572372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 67/128] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:40:39 2022] PUT /identity/v3/projects/c3806275c2874038ad80b383d2238272/users/3dd759a8e1e24b9baa56f4a701f83e0a/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:40:39.573703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a08ca-6659-49dd-bdd3-6e279bf50062 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.665837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:39.680124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf03a25-41f7-4976-8e32-1a7f293be7da None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:39.706437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a08ca-6659-49dd-bdd3-6e279bf50062 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:39.718271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd98f7-0052-42a4-adfd-964a5cd07509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.718912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd98f7-0052-42a4-adfd-964a5cd07509 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.719196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd98f7-0052-42a4-adfd-964a5cd07509 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.719470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd98f7-0052-42a4-adfd-964a5cd07509 None admin] PATH_INFO: `/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.720667 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd98f7-0052-42a4-adfd-964a5cd07509 None admin] RBAC: Authorizing `identity:get_user(user_id=3dd759a8e1e24b9baa56f4a701f83e0a)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:39.722445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd98f7-0052-42a4-adfd-964a5cd07509 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:39.724121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 62/129] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:39 2022] GET /identity/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:39.724920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd98f7-0052-42a4-adfd-964a5cd07509 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.747724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f222bf-d211-4411-bb2d-c5e124a16e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.748356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f222bf-d211-4411-bb2d-c5e124a16e58 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.748649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f222bf-d211-4411-bb2d-c5e124a16e58 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.748973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f222bf-d211-4411-bb2d-c5e124a16e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.749746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f222bf-d211-4411-bb2d-c5e124a16e58 None admin] RBAC: Adding query filter params (role.id=7a14ec7cc43c4b5fa0516c5d46f059db, scope.project.id=c3806275c2874038ad80b383d2238272, user.id=3a6ac8b61a2d4f57ac2fc15e54eaedc1) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:39.750053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f222bf-d211-4411-bb2d-c5e124a16e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:39.751642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f222bf-d211-4411-bb2d-c5e124a16e58 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:39.757788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 68/130] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:39 2022] GET /identity/v3/role_assignments?user.id=3a6ac8b61a2d4f57ac2fc15e54eaedc1&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=7a14ec7cc43c4b5fa0516c5d46f059db => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:39.758609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f222bf-d211-4411-bb2d-c5e124a16e58 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.763320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:39.849665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd98f7-0052-42a4-adfd-964a5cd07509 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:39.873751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f222bf-d211-4411-bb2d-c5e124a16e58 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:39.906464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:39.911405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa99a-7f0c-4c50-a1a6-e7c41b31148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.912050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa99a-7f0c-4c50-a1a6-e7c41b31148d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.912351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa99a-7f0c-4c50-a1a6-e7c41b31148d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.912670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa99a-7f0c-4c50-a1a6-e7c41b31148d None admin] PATH_INFO: `/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.914489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa99a-7f0c-4c50-a1a6-e7c41b31148d None admin] RBAC: Authorizing `identity:get_user(user_id=3dd759a8e1e24b9baa56f4a701f83e0a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:39.915934 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa99a-7f0c-4c50-a1a6-e7c41b31148d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:39.918122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 69/131] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:39 2022] GET /identity/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:39.918929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa99a-7f0c-4c50-a1a6-e7c41b31148d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:39.931590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a022f-2d22-4f2e-be29-2351fd31c2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:39.932235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a022f-2d22-4f2e-be29-2351fd31c2a2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:39.932516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a022f-2d22-4f2e-be29-2351fd31c2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:39.932788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a022f-2d22-4f2e-be29-2351fd31c2a2 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:39.933954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a022f-2d22-4f2e-be29-2351fd31c2a2 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:39.935408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a022f-2d22-4f2e-be29-2351fd31c2a2 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:39.937364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 63/132] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:39 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:39.938161 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a022f-2d22-4f2e-be29-2351fd31c2a2 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:40.036382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa99a-7f0c-4c50-a1a6-e7c41b31148d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:40.073885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8db935-9842-4cd3-8ab3-b5939a469b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:40.074522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8db935-9842-4cd3-8ab3-b5939a469b2f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:40.075171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8db935-9842-4cd3-8ab3-b5939a469b2f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:40.075447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8db935-9842-4cd3-8ab3-b5939a469b2f None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:40.077864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8db935-9842-4cd3-8ab3-b5939a469b2f None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:40.079366 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8db935-9842-4cd3-8ab3-b5939a469b2f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:40.081186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 70/133] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:39 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:40.081874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8db935-9842-4cd3-8ab3-b5939a469b2f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:40.109553 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:40.114577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a022f-2d22-4f2e-be29-2351fd31c2a2 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:40.153652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad1fcd-6f12-4357-87f7-801dc3e53e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:40.154752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad1fcd-6f12-4357-87f7-801dc3e53e7f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:40.155229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad1fcd-6f12-4357-87f7-801dc3e53e7f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:40.155897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:40.156537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad1fcd-6f12-4357-87f7-801dc3e53e7f None admin] PATH_INFO: `/v3/projects/f2b6d06068e74febb5c8467820a5cd7e` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:40.157963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad1fcd-6f12-4357-87f7-801dc3e53e7f None admin] RBAC: Authorizing `identity:get_project(project_id=f2b6d06068e74febb5c8467820a5cd7e)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:40.159600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad1fcd-6f12-4357-87f7-801dc3e53e7f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:40.161785 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 64/134] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:39 2022] GET /identity/v3/projects/f2b6d06068e74febb5c8467820a5cd7e => generated 312 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:40.162722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad1fcd-6f12-4357-87f7-801dc3e53e7f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:40.192680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8db935-9842-4cd3-8ab3-b5939a469b2f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:40.229692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a9059-5f0d-45f0-9b2f-6dbb264246cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:40.230432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a9059-5f0d-45f0-9b2f-6dbb264246cb None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:40.230715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a9059-5f0d-45f0-9b2f-6dbb264246cb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:40.230991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a9059-5f0d-45f0-9b2f-6dbb264246cb None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272/users/8525de726b7c407fab4fe9cbff320061/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:40.232932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a9059-5f0d-45f0-9b2f-6dbb264246cb None admin] RBAC: Authorizing `identity:create_grant(project_id=c3806275c2874038ad80b383d2238272, user_id=8525de726b7c407fab4fe9cbff320061, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:40.234623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a9059-5f0d-45f0-9b2f-6dbb264246cb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:40.309461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 71/135] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:40:40 2022] PUT /identity/v3/projects/c3806275c2874038ad80b383d2238272/users/8525de726b7c407fab4fe9cbff320061/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:40:40.310208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a9059-5f0d-45f0-9b2f-6dbb264246cb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:40.321037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad1fcd-6f12-4357-87f7-801dc3e53e7f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:40.403147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf247743-2bcb-4633-a086-5ced9ac59dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:40.403909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf247743-2bcb-4633-a086-5ced9ac59dc9 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:40.404149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf247743-2bcb-4633-a086-5ced9ac59dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:40.404418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf247743-2bcb-4633-a086-5ced9ac59dc9 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272/users/3dd759a8e1e24b9baa56f4a701f83e0a/roles/6654493feb544c46aeca606d309a1af2` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:40.408240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf247743-2bcb-4633-a086-5ced9ac59dc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3806275c2874038ad80b383d2238272, user_id=3dd759a8e1e24b9baa56f4a701f83e0a, role_id=6654493feb544c46aeca606d309a1af2)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:40.414397 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf247743-2bcb-4633-a086-5ced9ac59dc9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:40.486609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 65/136] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:40:40 2022] PUT /identity/v3/projects/c3806275c2874038ad80b383d2238272/users/3dd759a8e1e24b9baa56f4a701f83e0a/roles/6654493feb544c46aeca606d309a1af2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:40:40.488175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86017d-8cd7-46a1-a159-098931f3f87e None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:40.488460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86017d-8cd7-46a1-a159-098931f3f87e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:40.488735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86017d-8cd7-46a1-a159-098931f3f87e None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:40.490425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 66/137] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:40.497098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199651da-b50a-42cf-b5d0-d6ebe0b5719d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:40.497464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199651da-b50a-42cf-b5d0-d6ebe0b5719d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:40.497743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199651da-b50a-42cf-b5d0-d6ebe0b5719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:40.500635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a9059-5f0d-45f0-9b2f-6dbb264246cb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:40.538919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-199651da-b50a-42cf-b5d0-d6ebe0b5719d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:40.540152 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-199651da-b50a-42cf-b5d0-d6ebe0b5719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:40.570747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:40.583343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943dbec-3265-41a5-a835-50df5cd72678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:40.584086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943dbec-3265-41a5-a835-50df5cd72678 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:40.584352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943dbec-3265-41a5-a835-50df5cd72678 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:40.584905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943dbec-3265-41a5-a835-50df5cd72678 None admin] PATH_INFO: `/v3/projects/f2b6d06068e74febb5c8467820a5cd7e/users/3dd759a8e1e24b9baa56f4a701f83e0a/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:40.590123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:40.591224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943dbec-3265-41a5-a835-50df5cd72678 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2b6d06068e74febb5c8467820a5cd7e, user_id=3dd759a8e1e24b9baa56f4a701f83e0a, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:40.592872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943dbec-3265-41a5-a835-50df5cd72678 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:40.656346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 67/138] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:40.673207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 72/139] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:40:40 2022] PUT /identity/v3/projects/f2b6d06068e74febb5c8467820a5cd7e/users/3dd759a8e1e24b9baa56f4a701f83e0a/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:40:40.689282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199651da-b50a-42cf-b5d0-d6ebe0b5719d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:40.823681 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199651da-b50a-42cf-b5d0-d6ebe0b5719d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:40.864926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bd6a0-6264-438f-8186-484d768b46b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:40.865655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bd6a0-6264-438f-8186-484d768b46b4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:40.865939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bd6a0-6264-438f-8186-484d768b46b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:40.866213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bd6a0-6264-438f-8186-484d768b46b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:40.867968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bd6a0-6264-438f-8186-484d768b46b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:40.869458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bd6a0-6264-438f-8186-484d768b46b4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:40.871274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 68/140] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:40.876615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943dbec-3265-41a5-a835-50df5cd72678 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:41.003576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943dbec-3265-41a5-a835-50df5cd72678 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:41.044892 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4e84-0672-43d2-90f7-244741d11050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:41.045547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4e84-0672-43d2-90f7-244741d11050 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:41.045833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4e84-0672-43d2-90f7-244741d11050 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:41.046111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4e84-0672-43d2-90f7-244741d11050 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:41.046776 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4e84-0672-43d2-90f7-244741d11050 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:41.048242 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4e84-0672-43d2-90f7-244741d11050 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:41.172373 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 73/141] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:40:40 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:42.446258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2683d-2e2f-4ad2-b4f8-caa13a7d1022 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:42.446790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2683d-2e2f-4ad2-b4f8-caa13a7d1022 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:42.446790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2683d-2e2f-4ad2-b4f8-caa13a7d1022 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:42.448428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 69/142] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:42.455216 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8cc1c-6598-4c8a-8289-31ded4e4a7c0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:42.455660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8cc1c-6598-4c8a-8289-31ded4e4a7c0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:42.455837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8cc1c-6598-4c8a-8289-31ded4e4a7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:42.478325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1ce8cc1c-6598-4c8a-8289-31ded4e4a7c0 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:42.479503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1ce8cc1c-6598-4c8a-8289-31ded4e4a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:42.497405 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172a75-fa7a-4aec-b61e-c7e40a42e216 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:42.497708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172a75-fa7a-4aec-b61e-c7e40a42e216 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:42.497966 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172a75-fa7a-4aec-b61e-c7e40a42e216 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:42.499464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 70/143] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:40:42.507356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0a3da-ae7c-4905-84c4-b4cda833e90d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:42.507656 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0a3da-ae7c-4905-84c4-b4cda833e90d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:42.507935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0a3da-ae7c-4905-84c4-b4cda833e90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:42.530971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f7a0a3da-ae7c-4905-84c4-b4cda833e90d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:42.532140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:42.532648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f7a0a3da-ae7c-4905-84c4-b4cda833e90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:42.561776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:42.592979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 74/144] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:42.629972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 71/145] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:42.643649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8cc1c-6598-4c8a-8289-31ded4e4a7c0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:42.669504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0a3da-ae7c-4905-84c4-b4cda833e90d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:42.793603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0a3da-ae7c-4905-84c4-b4cda833e90d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:42.832793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe517ea-cbfa-4695-9690-de1729e870a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:42.834240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe517ea-cbfa-4695-9690-de1729e870a8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:42.834529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe517ea-cbfa-4695-9690-de1729e870a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:42.835349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe517ea-cbfa-4695-9690-de1729e870a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:42.847933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe517ea-cbfa-4695-9690-de1729e870a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-ffe517ea-cbfa-4695-9690-de1729e870a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:42.853586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:42.854493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:42.855267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 72/146] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:40:42.862010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe517ea-cbfa-4695-9690-de1729e870a8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:42.879253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8cc1c-6598-4c8a-8289-31ded4e4a7c0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:42.885679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:42.979168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe517ea-cbfa-4695-9690-de1729e870a8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:42.990030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80639a1b-c849-4862-af74-e389c7823039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:42.990687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80639a1b-c849-4862-af74-e389c7823039 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:42.991008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80639a1b-c849-4862-af74-e389c7823039 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:42.991294 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80639a1b-c849-4862-af74-e389c7823039 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.016508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569398d-9abf-4dbd-aa79-c98c337d3038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:43.017131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569398d-9abf-4dbd-aa79-c98c337d3038 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:43.017444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569398d-9abf-4dbd-aa79-c98c337d3038 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:43.017725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569398d-9abf-4dbd-aa79-c98c337d3038 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.018467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569398d-9abf-4dbd-aa79-c98c337d3038 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:43.018776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569398d-9abf-4dbd-aa79-c98c337d3038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:43.020577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569398d-9abf-4dbd-aa79-c98c337d3038 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:43.027564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80639a1b-c849-4862-af74-e389c7823039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:43.031068 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 73/147] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-80639a1b-c849-4862-af74-e389c7823039 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:43.032531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:43.033360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:43.034500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 75/148] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:43.036755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569398d-9abf-4dbd-aa79-c98c337d3038 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:43.041427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80639a1b-c849-4862-af74-e389c7823039 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:43.129001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:43.134638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:43.154598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569398d-9abf-4dbd-aa79-c98c337d3038 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:43.194880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d4c19-bf5e-4eba-ae44-ca1ae3db11b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:43.195512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d4c19-bf5e-4eba-ae44-ca1ae3db11b4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:43.195806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d4c19-bf5e-4eba-ae44-ca1ae3db11b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:43.196076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d4c19-bf5e-4eba-ae44-ca1ae3db11b4 None admin] PATH_INFO: `/v3/users/3a6ac8b61a2d4f57ac2fc15e54eaedc1` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.197244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d4c19-bf5e-4eba-ae44-ca1ae3db11b4 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6ac8b61a2d4f57ac2fc15e54eaedc1)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:43.199158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d4c19-bf5e-4eba-ae44-ca1ae3db11b4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:43.201230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 74/149] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:43 2022] GET /identity/v3/users/3a6ac8b61a2d4f57ac2fc15e54eaedc1 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:43.206774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d4c19-bf5e-4eba-ae44-ca1ae3db11b4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:43.325659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d4c19-bf5e-4eba-ae44-ca1ae3db11b4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:43.347180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80639a1b-c849-4862-af74-e389c7823039 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:43.373316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc1635-9a56-4d30-b274-90b9ebdd2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:43.373969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc1635-9a56-4d30-b274-90b9ebdd2559 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:43.374248 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc1635-9a56-4d30-b274-90b9ebdd2559 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:43.374525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc1635-9a56-4d30-b274-90b9ebdd2559 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.378618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc1635-9a56-4d30-b274-90b9ebdd2559 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:43.380142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc1635-9a56-4d30-b274-90b9ebdd2559 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:43.382670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 75/150] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:43 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:43.407005 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc1635-9a56-4d30-b274-90b9ebdd2559 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:43.426503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e70b78-5bda-4b6e-8964-df61af6d22c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:43.429438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e70b78-5bda-4b6e-8964-df61af6d22c6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:43.429723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e70b78-5bda-4b6e-8964-df61af6d22c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:43.429994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e70b78-5bda-4b6e-8964-df61af6d22c6 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.430677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e70b78-5bda-4b6e-8964-df61af6d22c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:43.431550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e70b78-5bda-4b6e-8964-df61af6d22c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:43.431664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:43.432973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e70b78-5bda-4b6e-8964-df61af6d22c6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:43.457140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 76/151] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:43.463116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e70b78-5bda-4b6e-8964-df61af6d22c6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:43.571504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc1635-9a56-4d30-b274-90b9ebdd2559 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:43.614049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c4854-7ed6-4c5d-b2ee-3f6450fc5cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:43.614752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c4854-7ed6-4c5d-b2ee-3f6450fc5cd5 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:43.615030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c4854-7ed6-4c5d-b2ee-3f6450fc5cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:43.615301 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c4854-7ed6-4c5d-b2ee-3f6450fc5cd5 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272/users/3a6ac8b61a2d4f57ac2fc15e54eaedc1/roles/7a14ec7cc43c4b5fa0516c5d46f059db` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.618451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c4854-7ed6-4c5d-b2ee-3f6450fc5cd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3806275c2874038ad80b383d2238272, user_id=3a6ac8b61a2d4f57ac2fc15e54eaedc1, role_id=7a14ec7cc43c4b5fa0516c5d46f059db)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:43.619917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c4854-7ed6-4c5d-b2ee-3f6450fc5cd5 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:43.639375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:43.648681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e70b78-5bda-4b6e-8964-df61af6d22c6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:43.689583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf99a9-d4cd-4146-b0e3-943f5810a76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:43.690929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf99a9-d4cd-4146-b0e3-943f5810a76d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:43.691441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf99a9-d4cd-4146-b0e3-943f5810a76d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:43.691924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf99a9-d4cd-4146-b0e3-943f5810a76d None admin] PATH_INFO: `/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.693525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf99a9-d4cd-4146-b0e3-943f5810a76d None admin] RBAC: Authorizing `identity:get_user(user_id=3dd759a8e1e24b9baa56f4a701f83e0a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:43.696021 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf99a9-d4cd-4146-b0e3-943f5810a76d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:43.697930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 77/152] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:43 2022] GET /identity/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:43.699312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb77a0-e1d4-44aa-83ac-dc15610e045a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:43.699815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb77a0-e1d4-44aa-83ac-dc15610e045a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:43.700330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb77a0-e1d4-44aa-83ac-dc15610e045a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.703593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 78/153] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:43.708773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb77a0-e1d4-44aa-83ac-dc15610e045a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:43.716310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 76/154] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:40:43 2022] PUT /identity/v3/projects/c3806275c2874038ad80b383d2238272/users/3a6ac8b61a2d4f57ac2fc15e54eaedc1/roles/7a14ec7cc43c4b5fa0516c5d46f059db => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 22:40:43.717423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527aad3-64c7-4527-83bc-85eda04bc818 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:43.717710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527aad3-64c7-4527-83bc-85eda04bc818 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:43.717984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527aad3-64c7-4527-83bc-85eda04bc818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.747324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e527aad3-64c7-4527-83bc-85eda04bc818 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:43.748542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e527aad3-64c7-4527-83bc-85eda04bc818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:43.859143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 77/155] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:43.861019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ded790-2902-40f1-b300-734d18437cd5 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:43.861651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ded790-2902-40f1-b300-734d18437cd5 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:43.862119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ded790-2902-40f1-b300-734d18437cd5 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.863808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 78/156] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:43.871228 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d85e72-f33c-4460-8662-580f92e75887 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:43.871889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d85e72-f33c-4460-8662-580f92e75887 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:43.872470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d85e72-f33c-4460-8662-580f92e75887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:43.881910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:43.903376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-74d85e72-f33c-4460-8662-580f92e75887 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:43.905190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-74d85e72-f33c-4460-8662-580f92e75887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:43.987521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb77a0-e1d4-44aa-83ac-dc15610e045a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:44.005211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 79/157] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:44.006420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d85e72-f33c-4460-8662-580f92e75887 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:44.068519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776b74e-9d2e-4dc7-a00d-8753934bfde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:44.069745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b74e-9d2e-4dc7-a00d-8753934bfde0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:44.070906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b74e-9d2e-4dc7-a00d-8753934bfde0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:44.071183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b74e-9d2e-4dc7-a00d-8753934bfde0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:44.130732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d85e72-f33c-4460-8662-580f92e75887 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:44.157721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:44.165267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:44.179814 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c4dc9-9cc0-4c74-85fd-951ee5d489be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:44.180464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c4dc9-9cc0-4c74-85fd-951ee5d489be None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:44.180741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c4dc9-9cc0-4c74-85fd-951ee5d489be None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:44.181010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c4dc9-9cc0-4c74-85fd-951ee5d489be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:44.203379 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c4dc9-9cc0-4c74-85fd-951ee5d489be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-9d4c4dc9-9cc0-4c74-85fd-951ee5d489be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:44.208416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:44.209386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:44.210791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:44.211418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 80/158] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:40:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:44.216653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c4dc9-9cc0-4c74-85fd-951ee5d489be None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:44.230041 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776b74e-9d2e-4dc7-a00d-8753934bfde0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:44.231511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776b74e-9d2e-4dc7-a00d-8753934bfde0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:44.401818 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c4dc9-9cc0-4c74-85fd-951ee5d489be None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:44.417165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 79/159] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:44.418449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea101-7909-434a-a5e5-cd65170a47f4 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:44.418699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea101-7909-434a-a5e5-cd65170a47f4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:44.418971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea101-7909-434a-a5e5-cd65170a47f4 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:44.420743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 80/160] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:44.421496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea101-7909-434a-a5e5-cd65170a47f4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:44.463312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82788a99-9c17-4332-8522-3104803096ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:44.463971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82788a99-9c17-4332-8522-3104803096ed None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:44.464246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82788a99-9c17-4332-8522-3104803096ed None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:44.464511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82788a99-9c17-4332-8522-3104803096ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:44.478759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82788a99-9c17-4332-8522-3104803096ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-82788a99-9c17-4332-8522-3104803096ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:44.483695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:44.484551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:44.485386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 81/161] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:44.486073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82788a99-9c17-4332-8522-3104803096ed None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:44.509053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:44.543942 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:44.553585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea101-7909-434a-a5e5-cd65170a47f4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:44.595634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89606d17-dc11-45ce-b53f-f0d03c1b5c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:44.596841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606d17-dc11-45ce-b53f-f0d03c1b5c90 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:44.597206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82788a99-9c17-4332-8522-3104803096ed None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:44.597979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606d17-dc11-45ce-b53f-f0d03c1b5c90 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:44.598457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606d17-dc11-45ce-b53f-f0d03c1b5c90 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:44.599516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89606d17-dc11-45ce-b53f-f0d03c1b5c90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:44.600027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89606d17-dc11-45ce-b53f-f0d03c1b5c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:44.601675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89606d17-dc11-45ce-b53f-f0d03c1b5c90 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:44.611196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 81/162] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:40:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:44.612842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ee276-cc41-48f2-ad00-171b7ff11441 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:44.613345 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ee276-cc41-48f2-ad00-171b7ff11441 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:44.613817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ee276-cc41-48f2-ad00-171b7ff11441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:44.633572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8f9ee276-cc41-48f2-ad00-171b7ff11441 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:44.633758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb16a10-5b55-4f1c-b6b0-476938ca2939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:44.634288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb16a10-5b55-4f1c-b6b0-476938ca2939 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:44.634567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb16a10-5b55-4f1c-b6b0-476938ca2939 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:44.634838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb16a10-5b55-4f1c-b6b0-476938ca2939 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:44.635992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb16a10-5b55-4f1c-b6b0-476938ca2939 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:44.636323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8f9ee276-cc41-48f2-ad00-171b7ff11441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:44.637450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb16a10-5b55-4f1c-b6b0-476938ca2939 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:44.639164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 82/163] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:44 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:44.639926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb16a10-5b55-4f1c-b6b0-476938ca2939 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:44.709524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 82/164] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:44.711246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ee276-cc41-48f2-ad00-171b7ff11441 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:44.746192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb16a10-5b55-4f1c-b6b0-476938ca2939 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:44.767869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:44.770638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:44.784110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fa54b-0f1c-4695-b56b-3e7cc25a5ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:44.784719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fa54b-0f1c-4695-b56b-3e7cc25a5ae9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:44.785016 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fa54b-0f1c-4695-b56b-3e7cc25a5ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:44.785327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fa54b-0f1c-4695-b56b-3e7cc25a5ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:44.786095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fa54b-0f1c-4695-b56b-3e7cc25a5ae9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:44.786455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fa54b-0f1c-4695-b56b-3e7cc25a5ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:44.788507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fa54b-0f1c-4695-b56b-3e7cc25a5ae9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:44.798983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 83/165] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:44.799660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fa54b-0f1c-4695-b56b-3e7cc25a5ae9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:44.822690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ee276-cc41-48f2-ad00-171b7ff11441 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:44.858642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef9efa-17a2-45e4-856b-4682d166d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:44.859637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef9efa-17a2-45e4-856b-4682d166d442 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:44.860173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef9efa-17a2-45e4-856b-4682d166d442 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:44.860635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef9efa-17a2-45e4-856b-4682d166d442 None admin] PATH_INFO: `/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:44.862108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef9efa-17a2-45e4-856b-4682d166d442 None admin] RBAC: Authorizing `identity:get_user(user_id=3dd759a8e1e24b9baa56f4a701f83e0a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:44.863788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef9efa-17a2-45e4-856b-4682d166d442 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:44.865596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 83/166] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:44 2022] GET /identity/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:44.867127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef9efa-17a2-45e4-856b-4682d166d442 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:44.913552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fa54b-0f1c-4695-b56b-3e7cc25a5ae9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:44.950196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8040e40-2cc2-4b92-9f06-93555c3590c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:44.950868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8040e40-2cc2-4b92-9f06-93555c3590c0 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:44.951131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8040e40-2cc2-4b92-9f06-93555c3590c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:44.951401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8040e40-2cc2-4b92-9f06-93555c3590c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:44.952359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8040e40-2cc2-4b92-9f06-93555c3590c0 None admin] RBAC: Adding query filter params (role.id=ec8d0b12e5324b00bca50fea232c8690, scope.project.id=c3806275c2874038ad80b383d2238272, user.id=3dd759a8e1e24b9baa56f4a701f83e0a) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:44.952666 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8040e40-2cc2-4b92-9f06-93555c3590c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:44.954265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8040e40-2cc2-4b92-9f06-93555c3590c0 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:44.963098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 84/167] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:44 2022] GET /identity/v3/role_assignments?user.id=3dd759a8e1e24b9baa56f4a701f83e0a&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:44.963857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8040e40-2cc2-4b92-9f06-93555c3590c0 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:44.985063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef9efa-17a2-45e4-856b-4682d166d442 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:45.019973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:45.021395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:45.038240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ec1f3-f8e3-4d86-b319-bbb23929bba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:45.039532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ec1f3-f8e3-4d86-b319-bbb23929bba8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:45.039801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ec1f3-f8e3-4d86-b319-bbb23929bba8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:45.040066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ec1f3-f8e3-4d86-b319-bbb23929bba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:45.056684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ec1f3-f8e3-4d86-b319-bbb23929bba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-693ec1f3-f8e3-4d86-b319-bbb23929bba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:45.064045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:45.064905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:45.065822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:45.067307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 84/168] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:45.067415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ec1f3-f8e3-4d86-b319-bbb23929bba8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:45.091158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8040e40-2cc2-4b92-9f06-93555c3590c0 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:45.138211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec726ad9-bdfd-44da-b74b-45db1bfc9161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:45.139412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec726ad9-bdfd-44da-b74b-45db1bfc9161 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:45.140280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec726ad9-bdfd-44da-b74b-45db1bfc9161 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:45.141009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec726ad9-bdfd-44da-b74b-45db1bfc9161 None admin] PATH_INFO: `/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:45.142646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec726ad9-bdfd-44da-b74b-45db1bfc9161 None admin] RBAC: Authorizing `identity:get_user(user_id=3dd759a8e1e24b9baa56f4a701f83e0a)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:45.144928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec726ad9-bdfd-44da-b74b-45db1bfc9161 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:45.148311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 85/169] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:44 2022] GET /identity/v3/users/3dd759a8e1e24b9baa56f4a701f83e0a => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:45.149513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec726ad9-bdfd-44da-b74b-45db1bfc9161 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:45.221460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ec1f3-f8e3-4d86-b319-bbb23929bba8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:45.304274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04965e4-eda4-49a1-b302-04f178ad399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:45.306961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04965e4-eda4-49a1-b302-04f178ad399b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:45.307491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04965e4-eda4-49a1-b302-04f178ad399b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:45.307952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04965e4-eda4-49a1-b302-04f178ad399b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:45.366431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec726ad9-bdfd-44da-b74b-45db1bfc9161 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:45.383224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:45.407248 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacfc2b-d978-480c-b29c-393fde9b85ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:45.408257 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacfc2b-d978-480c-b29c-393fde9b85ab None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:45.408730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacfc2b-d978-480c-b29c-393fde9b85ab None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:45.409221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacfc2b-d978-480c-b29c-393fde9b85ab None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:45.410127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacfc2b-d978-480c-b29c-393fde9b85ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:45.410620 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacfc2b-d978-480c-b29c-393fde9b85ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:45.412718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacfc2b-d978-480c-b29c-393fde9b85ab None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:45.423240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 86/170] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:45.424554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacfc2b-d978-480c-b29c-393fde9b85ab None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:45.444538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:45.470334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04965e4-eda4-49a1-b302-04f178ad399b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:45.472121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04965e4-eda4-49a1-b302-04f178ad399b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:45.611658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacfc2b-d978-480c-b29c-393fde9b85ab None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:45.657883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 85/171] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:45.658644 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04965e4-eda4-49a1-b302-04f178ad399b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:45.678799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849a45a-7b05-449f-8865-a23287b3db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:45.679412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849a45a-7b05-449f-8865-a23287b3db08 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:45.679687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849a45a-7b05-449f-8865-a23287b3db08 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:45.679951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849a45a-7b05-449f-8865-a23287b3db08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:45.759772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:45.804155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849a45a-7b05-449f-8865-a23287b3db08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:45.805895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849a45a-7b05-449f-8865-a23287b3db08 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:45.812347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:45.851520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04965e4-eda4-49a1-b302-04f178ad399b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:45.950038 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e3a0a-6785-4803-9103-a6abce1171c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:45.950688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e3a0a-6785-4803-9103-a6abce1171c5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:45.950963 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e3a0a-6785-4803-9103-a6abce1171c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:45.951232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e3a0a-6785-4803-9103-a6abce1171c5 None admin] PATH_INFO: `/v3/users/8525de726b7c407fab4fe9cbff320061` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:45.952404 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e3a0a-6785-4803-9103-a6abce1171c5 None admin] RBAC: Authorizing `identity:get_user(user_id=8525de726b7c407fab4fe9cbff320061)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:45.953876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e3a0a-6785-4803-9103-a6abce1171c5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:45.955736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 86/172] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:45 2022] GET /identity/v3/users/8525de726b7c407fab4fe9cbff320061 => generated 247 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:45.956497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e3a0a-6785-4803-9103-a6abce1171c5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:46.081975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 87/173] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:46.082816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849a45a-7b05-449f-8865-a23287b3db08 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:46.170958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e3a0a-6785-4803-9103-a6abce1171c5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:46.212414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111baf95-95a9-4d1f-9919-f0f799b2cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:46.213047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111baf95-95a9-4d1f-9919-f0f799b2cf29 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.213341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111baf95-95a9-4d1f-9919-f0f799b2cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.213611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111baf95-95a9-4d1f-9919-f0f799b2cf29 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.223577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111baf95-95a9-4d1f-9919-f0f799b2cf29 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:46.225556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111baf95-95a9-4d1f-9919-f0f799b2cf29 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:46.227398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 87/174] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:45 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:46.227987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111baf95-95a9-4d1f-9919-f0f799b2cf29 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:46.233631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:46.274721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:46.281784 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849a45a-7b05-449f-8865-a23287b3db08 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:46.339389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a672a9c-a8b4-4946-85be-ddb31ac55d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:46.339891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a672a9c-a8b4-4946-85be-ddb31ac55d76 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.340320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a672a9c-a8b4-4946-85be-ddb31ac55d76 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.341272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a672a9c-a8b4-4946-85be-ddb31ac55d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.389553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111baf95-95a9-4d1f-9919-f0f799b2cf29 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:46.426101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976feb1f-0911-4ec5-b10e-2ed1fbdde475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:46.426920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976feb1f-0911-4ec5-b10e-2ed1fbdde475 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.427288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976feb1f-0911-4ec5-b10e-2ed1fbdde475 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.427655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976feb1f-0911-4ec5-b10e-2ed1fbdde475 None admin] PATH_INFO: `/v3/projects/f2b6d06068e74febb5c8467820a5cd7e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.428903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976feb1f-0911-4ec5-b10e-2ed1fbdde475 None admin] RBAC: Authorizing `identity:get_project(project_id=f2b6d06068e74febb5c8467820a5cd7e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:46.430491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a672a9c-a8b4-4946-85be-ddb31ac55d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:46.430607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976feb1f-0911-4ec5-b10e-2ed1fbdde475 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:46.431938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a672a9c-a8b4-4946-85be-ddb31ac55d76 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:46.432451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 88/175] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:46 2022] GET /identity/v3/projects/f2b6d06068e74febb5c8467820a5cd7e => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:46.433358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976feb1f-0911-4ec5-b10e-2ed1fbdde475 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:46.532332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:46.542491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:46.547263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976feb1f-0911-4ec5-b10e-2ed1fbdde475 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:46.578396 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 88/176] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:46.580749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfadcc3-a8df-4b9f-9528-07ce5bf45740 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.581344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfadcc3-a8df-4b9f-9528-07ce5bf45740 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.581836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfadcc3-a8df-4b9f-9528-07ce5bf45740 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.583420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 89/177] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:46.585193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2faa-05ca-45ba-9195-4bbdef58e38e None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.585734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2faa-05ca-45ba-9195-4bbdef58e38e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.586374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2faa-05ca-45ba-9195-4bbdef58e38e None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.588088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 90/178] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:46.589457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a2faa-05ca-45ba-9195-4bbdef58e38e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:46.600834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a1d09-0d8a-4f80-8e3d-9f5165940bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:46.601565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a1d09-0d8a-4f80-8e3d-9f5165940bea None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.601839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a1d09-0d8a-4f80-8e3d-9f5165940bea None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.602109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a1d09-0d8a-4f80-8e3d-9f5165940bea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.602834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a1d09-0d8a-4f80-8e3d-9f5165940bea None admin] RBAC: Adding query filter params (role.id=6654493feb544c46aeca606d309a1af2, scope.project.id=c3806275c2874038ad80b383d2238272, user.id=3dd759a8e1e24b9baa56f4a701f83e0a) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:46.603191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a1d09-0d8a-4f80-8e3d-9f5165940bea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:46.605743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a1d09-0d8a-4f80-8e3d-9f5165940bea None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:46.614151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 89/179] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:46 2022] GET /identity/v3/role_assignments?user.id=3dd759a8e1e24b9baa56f4a701f83e0a&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=6654493feb544c46aeca606d309a1af2 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:46.615085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a1d09-0d8a-4f80-8e3d-9f5165940bea None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:46.724614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a2faa-05ca-45ba-9195-4bbdef58e38e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:46.758052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a1d09-0d8a-4f80-8e3d-9f5165940bea None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:46.780727 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0097fc2-e9e3-45f4-adc1-2bc0c641330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:46.781370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097fc2-e9e3-45f4-adc1-2bc0c641330d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.781648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097fc2-e9e3-45f4-adc1-2bc0c641330d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.781914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097fc2-e9e3-45f4-adc1-2bc0c641330d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.782644 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0097fc2-e9e3-45f4-adc1-2bc0c641330d None admin] RBAC: Adding query filter params (role.id=ec8d0b12e5324b00bca50fea232c8690, scope.project.id=f2b6d06068e74febb5c8467820a5cd7e, user.id=3dd759a8e1e24b9baa56f4a701f83e0a) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:46.783109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0097fc2-e9e3-45f4-adc1-2bc0c641330d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:46.785887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0097fc2-e9e3-45f4-adc1-2bc0c641330d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:46.795312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 91/180] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:46 2022] GET /identity/v3/role_assignments?user.id=3dd759a8e1e24b9baa56f4a701f83e0a&scope.project.id=f2b6d06068e74febb5c8467820a5cd7e&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:46.797329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec41c2c-4cd0-4ed5-813a-9ff9e060386c None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.797623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec41c2c-4cd0-4ed5-813a-9ff9e060386c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.798127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec41c2c-4cd0-4ed5-813a-9ff9e060386c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.810278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6aed25-f480-470a-b4a7-95cb68cefcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:46.811298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aed25-f480-470a-b4a7-95cb68cefcf6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.811802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aed25-f480-470a-b4a7-95cb68cefcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.812278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aed25-f480-470a-b4a7-95cb68cefcf6 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.813903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6aed25-f480-470a-b4a7-95cb68cefcf6 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:46.815619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6aed25-f480-470a-b4a7-95cb68cefcf6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:46.818515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 90/181] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:46 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:46.820612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31276-18ec-40ff-82f0-91e97e9a5936 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.821109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31276-18ec-40ff-82f0-91e97e9a5936 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.822555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31276-18ec-40ff-82f0-91e97e9a5936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.826226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-1ec41c2c-4cd0-4ed5-813a-9ff9e060386c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:46.827568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1ec41c2c-4cd0-4ed5-813a-9ff9e060386c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:46.845955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-67c31276-18ec-40ff-82f0-91e97e9a5936 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:46.847804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-67c31276-18ec-40ff-82f0-91e97e9a5936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:46.866107 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:46.881666 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:46.928345 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 92/182] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:46.930116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414bc65-59bc-49c7-9bc1-3396e5064420 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.930395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414bc65-59bc-49c7-9bc1-3396e5064420 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.930663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414bc65-59bc-49c7-9bc1-3396e5064420 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.932751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 93/183] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:46.933770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414bc65-59bc-49c7-9bc1-3396e5064420 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:46.938743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 91/184] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:46.940091 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5dae4-45d3-47a0-b8bb-552370f9b13a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.940376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5dae4-45d3-47a0-b8bb-552370f9b13a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.940654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5dae4-45d3-47a0-b8bb-552370f9b13a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.945318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 92/185] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:46.945318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf080a06-9685-4b86-bc2f-41b0e3558b5a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:46.945318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf080a06-9685-4b86-bc2f-41b0e3558b5a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:46.945318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf080a06-9685-4b86-bc2f-41b0e3558b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:46.963551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bf080a06-9685-4b86-bc2f-41b0e3558b5a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:46.964783 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bf080a06-9685-4b86-bc2f-41b0e3558b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:47.052136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 93/186] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:47.053456 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbf7f7-c354-4208-b537-abdad64bf11c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.053738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbf7f7-c354-4208-b537-abdad64bf11c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.054009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbf7f7-c354-4208-b537-abdad64bf11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.073096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7adbf7f7-c354-4208-b537-abdad64bf11c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:47.074313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7adbf7f7-c354-4208-b537-abdad64bf11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:47.091591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414bc65-59bc-49c7-9bc1-3396e5064420 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:47.128210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491f35b-1ccc-420f-9252-447dc26533e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:47.128715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491f35b-1ccc-420f-9252-447dc26533e4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.128988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491f35b-1ccc-420f-9252-447dc26533e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.129255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491f35b-1ccc-420f-9252-447dc26533e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.130056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491f35b-1ccc-420f-9252-447dc26533e4 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=c3806275c2874038ad80b383d2238272, user.id=8525de726b7c407fab4fe9cbff320061) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:47.130356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491f35b-1ccc-420f-9252-447dc26533e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:47.132340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491f35b-1ccc-420f-9252-447dc26533e4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:47.138133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 94/187] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:46 2022] GET /identity/v3/role_assignments?user.id=8525de726b7c407fab4fe9cbff320061&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=edba0d8c079245a38a321d2d77d25419 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:47.139099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491f35b-1ccc-420f-9252-447dc26533e4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:47.173327 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 94/188] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:47.173327 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbf7f7-c354-4208-b537-abdad64bf11c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:47.184242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:47.190464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:47.263736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491f35b-1ccc-420f-9252-447dc26533e4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:47.294969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbf7f7-c354-4208-b537-abdad64bf11c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:47.304967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dedca-2942-4039-a21c-62c8a5f082c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:47.305993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dedca-2942-4039-a21c-62c8a5f082c8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.306267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dedca-2942-4039-a21c-62c8a5f082c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.306535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dedca-2942-4039-a21c-62c8a5f082c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.319546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dedca-2942-4039-a21c-62c8a5f082c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-b01dedca-2942-4039-a21c-62c8a5f082c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:47.324691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:47.325825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 95/189] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:40:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:47.326664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dedca-2942-4039-a21c-62c8a5f082c8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:47.342612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbb06c-f06d-448e-990a-7c110c646b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:47.343646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbb06c-f06d-448e-990a-7c110c646b41 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.344020 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbb06c-f06d-448e-990a-7c110c646b41 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.344404 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbb06c-f06d-448e-990a-7c110c646b41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.357740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbb06c-f06d-448e-990a-7c110c646b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-55dbb06c-f06d-448e-990a-7c110c646b41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:47.363135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:47.364093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 95/190] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:47.364847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbb06c-f06d-448e-990a-7c110c646b41 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:47.434871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:47.439979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:47.441078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dedca-2942-4039-a21c-62c8a5f082c8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:47.469968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbb06c-f06d-448e-990a-7c110c646b41 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:47.475501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f1c1c-8609-448f-81ac-3a5b8244e1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:47.476154 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f1c1c-8609-448f-81ac-3a5b8244e1aa None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.476424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f1c1c-8609-448f-81ac-3a5b8244e1aa None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.476787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f1c1c-8609-448f-81ac-3a5b8244e1aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.477919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f1c1c-8609-448f-81ac-3a5b8244e1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:47.479415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f1c1c-8609-448f-81ac-3a5b8244e1aa None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:47.480961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 96/191] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:47.481795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f1c1c-8609-448f-81ac-3a5b8244e1aa None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:47.506213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af5c72-b325-488a-8e16-ae8a213a5721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:47.506842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af5c72-b325-488a-8e16-ae8a213a5721 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.507112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af5c72-b325-488a-8e16-ae8a213a5721 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.507378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af5c72-b325-488a-8e16-ae8a213a5721 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.517344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af5c72-b325-488a-8e16-ae8a213a5721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-79af5c72-b325-488a-8e16-ae8a213a5721 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:47.522090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:47.523159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 96/192] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:47.524029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af5c72-b325-488a-8e16-ae8a213a5721 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:47.584704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f1c1c-8609-448f-81ac-3a5b8244e1aa None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:47.620144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a4395-3c6f-40f4-90fb-e105536463ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:47.620742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a4395-3c6f-40f4-90fb-e105536463ae None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.621010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a4395-3c6f-40f4-90fb-e105536463ae None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.621273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a4395-3c6f-40f4-90fb-e105536463ae None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.621956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a4395-3c6f-40f4-90fb-e105536463ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:47.622247 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a4395-3c6f-40f4-90fb-e105536463ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:47.623593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a4395-3c6f-40f4-90fb-e105536463ae None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:47.628938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af5c72-b325-488a-8e16-ae8a213a5721 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:47.631797 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 97/193] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:40:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:47.632203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a4395-3c6f-40f4-90fb-e105536463ae None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:47.656499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:47.657687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:47.663068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7c71-53c8-402c-97f1-7ebbdaf18643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:47.663668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7c71-53c8-402c-97f1-7ebbdaf18643 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.663939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7c71-53c8-402c-97f1-7ebbdaf18643 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.664211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7c71-53c8-402c-97f1-7ebbdaf18643 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.664866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa7c71-53c8-402c-97f1-7ebbdaf18643 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:47.665161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa7c71-53c8-402c-97f1-7ebbdaf18643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:47.666578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa7c71-53c8-402c-97f1-7ebbdaf18643 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:47.674771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 97/194] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:47.675561 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7c71-53c8-402c-97f1-7ebbdaf18643 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:47.735025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a4395-3c6f-40f4-90fb-e105536463ae None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:47.767958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91f9ec-a6d3-4508-808e-b18ec681f558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:47.768552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91f9ec-a6d3-4508-808e-b18ec681f558 None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.768819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91f9ec-a6d3-4508-808e-b18ec681f558 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.769078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91f9ec-a6d3-4508-808e-b18ec681f558 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.769747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91f9ec-a6d3-4508-808e-b18ec681f558 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:47.771168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91f9ec-a6d3-4508-808e-b18ec681f558 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:47.779778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7c71-53c8-402c-97f1-7ebbdaf18643 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:47.815124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3fea3-729a-4169-892c-1b922e6d256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:47.815721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3fea3-729a-4169-892c-1b922e6d256c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.815992 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3fea3-729a-4169-892c-1b922e6d256c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.816256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3fea3-729a-4169-892c-1b922e6d256c None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.816902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3fea3-729a-4169-892c-1b922e6d256c None admin] RBAC: Adding query filter params (name=reader) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:47.817195 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3fea3-729a-4169-892c-1b922e6d256c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:47.818691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3fea3-729a-4169-892c-1b922e6d256c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:47.826493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 98/195] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:47.827332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3fea3-729a-4169-892c-1b922e6d256c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:47.875433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 98/196] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:40:47 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:47.875433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91f9ec-a6d3-4508-808e-b18ec681f558 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:47.893418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:47.944425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3fea3-729a-4169-892c-1b922e6d256c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:47.961360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:47.983780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6523c-edf5-458e-9262-5e35c59b6f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:47.984419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6523c-edf5-458e-9262-5e35c59b6f87 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:47.984690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6523c-edf5-458e-9262-5e35c59b6f87 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:47.984956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6523c-edf5-458e-9262-5e35c59b6f87 None admin] PATH_INFO: `/v3/users/fe30c68c376f4cd6884d906542041c69` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:47.986948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91f9ec-a6d3-4508-808e-b18ec681f558 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:48.000190 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6523c-edf5-458e-9262-5e35c59b6f87 None admin] RBAC: Authorizing `identity:get_user(user_id=fe30c68c376f4cd6884d906542041c69)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:48.001727 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6523c-edf5-458e-9262-5e35c59b6f87 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:48.003484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 99/197] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:47 2022] GET /identity/v3/users/fe30c68c376f4cd6884d906542041c69 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:48.004292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6523c-edf5-458e-9262-5e35c59b6f87 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:48.040493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3e8b2-f5cd-4213-b397-6f8420f7def1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:48.041132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e8b2-f5cd-4213-b397-6f8420f7def1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:48.041483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e8b2-f5cd-4213-b397-6f8420f7def1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:48.041751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3e8b2-f5cd-4213-b397-6f8420f7def1 None admin] PATH_INFO: `/v3/users/fe30c68c376f4cd6884d906542041c69` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:48.044252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3e8b2-f5cd-4213-b397-6f8420f7def1 None admin] RBAC: Authorizing `identity:get_user(user_id=fe30c68c376f4cd6884d906542041c69)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:48.045737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3e8b2-f5cd-4213-b397-6f8420f7def1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:48.047951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 99/198] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:47 2022] GET /identity/v3/users/fe30c68c376f4cd6884d906542041c69 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:48.048146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3e8b2-f5cd-4213-b397-6f8420f7def1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:48.131727 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6523c-edf5-458e-9262-5e35c59b6f87 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:48.150117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:48.177734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3e8b2-f5cd-4213-b397-6f8420f7def1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:48.182227 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c7bd5-c8c3-42df-8e64-68d09ddf0d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:48.182873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c7bd5-c8c3-42df-8e64-68d09ddf0d60 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:48.183212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c7bd5-c8c3-42df-8e64-68d09ddf0d60 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:48.183489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c7bd5-c8c3-42df-8e64-68d09ddf0d60 None admin] PATH_INFO: `/v3/users/3a6ac8b61a2d4f57ac2fc15e54eaedc1` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:48.184729 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c7bd5-c8c3-42df-8e64-68d09ddf0d60 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6ac8b61a2d4f57ac2fc15e54eaedc1)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:48.186514 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c7bd5-c8c3-42df-8e64-68d09ddf0d60 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:48.188241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 100/199] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:48 2022] GET /identity/v3/users/3a6ac8b61a2d4f57ac2fc15e54eaedc1 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:48.189030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c7bd5-c8c3-42df-8e64-68d09ddf0d60 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:48.228177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe44de5-527f-401e-b51d-95ba07ecfb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:48.228789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe44de5-527f-401e-b51d-95ba07ecfb36 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:48.229069 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe44de5-527f-401e-b51d-95ba07ecfb36 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:48.229542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe44de5-527f-401e-b51d-95ba07ecfb36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:48.250618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:48.326610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c7bd5-c8c3-42df-8e64-68d09ddf0d60 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:48.328687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe44de5-527f-401e-b51d-95ba07ecfb36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:48.331268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe44de5-527f-401e-b51d-95ba07ecfb36 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:48.367441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d17e5e-db21-4e6c-b9f4-1f5929341f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:48.368055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d17e5e-db21-4e6c-b9f4-1f5929341f9a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:48.368346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d17e5e-db21-4e6c-b9f4-1f5929341f9a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:48.369017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d17e5e-db21-4e6c-b9f4-1f5929341f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:48.431274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:48.452476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d17e5e-db21-4e6c-b9f4-1f5929341f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:48.454294 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d17e5e-db21-4e6c-b9f4-1f5929341f9a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:48.454542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 100/200] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:48.460564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe44de5-527f-401e-b51d-95ba07ecfb36 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:48.509407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:48.563861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe44de5-527f-401e-b51d-95ba07ecfb36 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:48.569727 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 101/201] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:48.570633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d17e5e-db21-4e6c-b9f4-1f5929341f9a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:48.602143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897c597-cf5c-4691-9d8b-10b9df8d24c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:48.602875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c597-cf5c-4691-9d8b-10b9df8d24c7 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:48.603150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c597-cf5c-4691-9d8b-10b9df8d24c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:48.603421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c597-cf5c-4691-9d8b-10b9df8d24c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:48.655121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:48.674433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d17e5e-db21-4e6c-b9f4-1f5929341f9a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:48.676288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897c597-cf5c-4691-9d8b-10b9df8d24c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:48.678550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897c597-cf5c-4691-9d8b-10b9df8d24c7 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:48.713415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7812820-909a-459b-8fec-a1ca02ce28aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:48.714048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7812820-909a-459b-8fec-a1ca02ce28aa None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:48.714327 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7812820-909a-459b-8fec-a1ca02ce28aa None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:48.714597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7812820-909a-459b-8fec-a1ca02ce28aa None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:48.715730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7812820-909a-459b-8fec-a1ca02ce28aa None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:48.717207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7812820-909a-459b-8fec-a1ca02ce28aa None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:48.719093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 102/202] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:48 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:48.719688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7812820-909a-459b-8fec-a1ca02ce28aa None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:48.736393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:48.800773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 101/203] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:48.802046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897c597-cf5c-4691-9d8b-10b9df8d24c7 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:48.831408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7812820-909a-459b-8fec-a1ca02ce28aa None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:48.867871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45800013-6bf9-4686-9e75-5f1c3492be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:48.868498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45800013-6bf9-4686-9e75-5f1c3492be38 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:48.868774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45800013-6bf9-4686-9e75-5f1c3492be38 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:48.869046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45800013-6bf9-4686-9e75-5f1c3492be38 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:48.870195 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45800013-6bf9-4686-9e75-5f1c3492be38 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:48.871631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45800013-6bf9-4686-9e75-5f1c3492be38 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:48.873391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 103/204] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:48 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:48.874158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45800013-6bf9-4686-9e75-5f1c3492be38 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:48.893173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:48.914048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897c597-cf5c-4691-9d8b-10b9df8d24c7 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:48.957507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642e89a-d1ff-4a00-b3ef-c7be944c23fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:48.958112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642e89a-d1ff-4a00-b3ef-c7be944c23fd None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:48.958380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642e89a-d1ff-4a00-b3ef-c7be944c23fd None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:48.958806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642e89a-d1ff-4a00-b3ef-c7be944c23fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:48.959924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642e89a-d1ff-4a00-b3ef-c7be944c23fd None admin] RBAC: Adding query filter params (role.id=6654493feb544c46aeca606d309a1af2, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf, user.id=fe30c68c376f4cd6884d906542041c69) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:48.960228 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642e89a-d1ff-4a00-b3ef-c7be944c23fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:48.962133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642e89a-d1ff-4a00-b3ef-c7be944c23fd None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:48.968843 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 102/205] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:48 2022] GET /identity/v3/role_assignments?user.id=fe30c68c376f4cd6884d906542041c69&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=6654493feb544c46aeca606d309a1af2 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:48.969766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642e89a-d1ff-4a00-b3ef-c7be944c23fd None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:48.996222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45800013-6bf9-4686-9e75-5f1c3492be38 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:49.000135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:49.076415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7404a0c-74c4-403d-8d35-a6b7a23fe448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:49.076979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7404a0c-74c4-403d-8d35-a6b7a23fe448 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:49.077251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7404a0c-74c4-403d-8d35-a6b7a23fe448 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:49.077540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7404a0c-74c4-403d-8d35-a6b7a23fe448 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:49.079829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7404a0c-74c4-403d-8d35-a6b7a23fe448 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:49.081284 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7404a0c-74c4-403d-8d35-a6b7a23fe448 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:49.082972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 104/206] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:48 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:49.089117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7404a0c-74c4-403d-8d35-a6b7a23fe448 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:49.193713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:49.209390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7404a0c-74c4-403d-8d35-a6b7a23fe448 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:49.246313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642e89a-d1ff-4a00-b3ef-c7be944c23fd None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:49.249748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f503ad4-2463-4d85-b13b-3f347ebca883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:49.250356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f503ad4-2463-4d85-b13b-3f347ebca883 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:49.250628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f503ad4-2463-4d85-b13b-3f347ebca883 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:49.250896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f503ad4-2463-4d85-b13b-3f347ebca883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:49.251629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f503ad4-2463-4d85-b13b-3f347ebca883 None admin] RBAC: Adding query filter params (role.id=7a14ec7cc43c4b5fa0516c5d46f059db, scope.project.id=c3806275c2874038ad80b383d2238272, user.id=3a6ac8b61a2d4f57ac2fc15e54eaedc1) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:49.251926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f503ad4-2463-4d85-b13b-3f347ebca883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:49.253387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f503ad4-2463-4d85-b13b-3f347ebca883 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:49.260766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 105/207] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:49 2022] GET /identity/v3/role_assignments?user.id=3a6ac8b61a2d4f57ac2fc15e54eaedc1&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=7a14ec7cc43c4b5fa0516c5d46f059db => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:49.290456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb30e3-5003-4a5a-b3fa-2326ecf7d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:49.291075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb30e3-5003-4a5a-b3fa-2326ecf7d21c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:49.291349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb30e3-5003-4a5a-b3fa-2326ecf7d21c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:49.291617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb30e3-5003-4a5a-b3fa-2326ecf7d21c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:49.292345 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb30e3-5003-4a5a-b3fa-2326ecf7d21c None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf, user.id=fe30c68c376f4cd6884d906542041c69) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:49.292647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb30e3-5003-4a5a-b3fa-2326ecf7d21c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:49.294133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb30e3-5003-4a5a-b3fa-2326ecf7d21c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:49.300751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 103/208] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:48 2022] GET /identity/v3/role_assignments?user.id=fe30c68c376f4cd6884d906542041c69&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=edba0d8c079245a38a321d2d77d25419 => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:50.155071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ac05-fd9a-480c-a8df-b8711fbf726d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:50.155071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ac05-fd9a-480c-a8df-b8711fbf726d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:50.155071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ac05-fd9a-480c-a8df-b8711fbf726d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:50.155071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 106/209] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:50.160515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e534a1-d9f8-4f69-8233-33a16e10a3c0 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:50.160925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e534a1-d9f8-4f69-8233-33a16e10a3c0 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:50.161106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e534a1-d9f8-4f69-8233-33a16e10a3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:50.180865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-50e534a1-d9f8-4f69-8233-33a16e10a3c0 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:50.183384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-50e534a1-d9f8-4f69-8233-33a16e10a3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:50.207580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3a36a-9919-4300-b721-1c4f79beae6f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:50.208309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3a36a-9919-4300-b721-1c4f79beae6f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:50.209163 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3a36a-9919-4300-b721-1c4f79beae6f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:50.211228 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 107/210] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:40:50.217379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555c45-c758-4318-8931-93c195059005 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:50.218268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555c45-c758-4318-8931-93c195059005 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:50.219004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95555c45-c758-4318-8931-93c195059005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:50.242808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-95555c45-c758-4318-8931-93c195059005 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:50.244600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-95555c45-c758-4318-8931-93c195059005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:50.262759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 104/211] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:50.286217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e534a1-d9f8-4f69-8233-33a16e10a3c0 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:50.294661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:50.324032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 108/212] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:50.351784 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555c45-c758-4318-8931-93c195059005 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:50.414787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e534a1-d9f8-4f69-8233-33a16e10a3c0 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:50.432492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:50.454772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95555c45-c758-4318-8931-93c195059005 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:50.464249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250f802-96d7-4b1b-ad01-e5d5558274fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:50.465831 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250f802-96d7-4b1b-ad01-e5d5558274fd None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:50.466714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250f802-96d7-4b1b-ad01-e5d5558274fd None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:50.467177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250f802-96d7-4b1b-ad01-e5d5558274fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:50.482108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250f802-96d7-4b1b-ad01-e5d5558274fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-9250f802-96d7-4b1b-ad01-e5d5558274fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:50.489077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:50.490609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:50.491372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:50.493491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 105/213] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:40:50.498049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852a88b-7765-4a5f-9ded-fe1eefa5a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:50.498879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a88b-7765-4a5f-9ded-fe1eefa5a806 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:50.499146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a88b-7765-4a5f-9ded-fe1eefa5a806 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:50.499405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852a88b-7765-4a5f-9ded-fe1eefa5a806 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:50.500759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250f802-96d7-4b1b-ad01-e5d5558274fd None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:50.502089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852a88b-7765-4a5f-9ded-fe1eefa5a806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:50.503883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852a88b-7765-4a5f-9ded-fe1eefa5a806 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:50.506487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 109/214] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:50.511981 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852a88b-7765-4a5f-9ded-fe1eefa5a806 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:50.586491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:50.635388 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250f802-96d7-4b1b-ad01-e5d5558274fd None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:50.639742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852a88b-7765-4a5f-9ded-fe1eefa5a806 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:50.673802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9762459-26d9-4e86-9ed7-bbca70fdd078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:50.674625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9762459-26d9-4e86-9ed7-bbca70fdd078 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:50.674779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9cc9b-d07e-40c3-a1b0-77d9664609d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:50.675201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9762459-26d9-4e86-9ed7-bbca70fdd078 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:50.675375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9cc9b-d07e-40c3-a1b0-77d9664609d2 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:50.675647 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9cc9b-d07e-40c3-a1b0-77d9664609d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:50.675897 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9762459-26d9-4e86-9ed7-bbca70fdd078 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:50.676002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9cc9b-d07e-40c3-a1b0-77d9664609d2 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:50.676535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9cc9b-d07e-40c3-a1b0-77d9664609d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:50.676925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9762459-26d9-4e86-9ed7-bbca70fdd078 None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:50.677439 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9762459-26d9-4e86-9ed7-bbca70fdd078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:50.678582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9cc9b-d07e-40c3-a1b0-77d9664609d2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:50.679675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9762459-26d9-4e86-9ed7-bbca70fdd078 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:50.690677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 106/215] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:50.696262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9762459-26d9-4e86-9ed7-bbca70fdd078 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:50.754643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 110/216] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:40:50 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:50.827706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9762459-26d9-4e86-9ed7-bbca70fdd078 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:50.857854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:50.867144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab835a2-9dd7-424d-abc5-439ce286cad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:50.867789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab835a2-9dd7-424d-abc5-439ce286cad1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:50.868060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab835a2-9dd7-424d-abc5-439ce286cad1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:50.868324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab835a2-9dd7-424d-abc5-439ce286cad1 None admin] PATH_INFO: `/v3/users/f6e4326eb3624a6ca5d03a1937b23113` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:50.884099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab835a2-9dd7-424d-abc5-439ce286cad1 None admin] RBAC: Authorizing `identity:get_user(user_id=f6e4326eb3624a6ca5d03a1937b23113)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:50.885837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab835a2-9dd7-424d-abc5-439ce286cad1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:50.887929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 107/217] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:50 2022] GET /identity/v3/users/f6e4326eb3624a6ca5d03a1937b23113 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:50.893326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9cc9b-d07e-40c3-a1b0-77d9664609d2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:50.899468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:51.009236 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9cc9b-d07e-40c3-a1b0-77d9664609d2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:51.058296 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934e2b-d1c1-4d16-b4eb-9e5f114e797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:51.059744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934e2b-d1c1-4d16-b4eb-9e5f114e797c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.060232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934e2b-d1c1-4d16-b4eb-9e5f114e797c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.060700 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934e2b-d1c1-4d16-b4eb-9e5f114e797c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:51.091693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd593a-459e-4041-8fa4-49103f0b0b4f None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.092029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd593a-459e-4041-8fa4-49103f0b0b4f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.092245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd593a-459e-4041-8fa4-49103f0b0b4f None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:51.093765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 108/218] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:51.102067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18405a79-d5d3-44e4-8fcb-31b32b807584 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.102375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18405a79-d5d3-44e4-8fcb-31b32b807584 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.102613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18405a79-d5d3-44e4-8fcb-31b32b807584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:51.131227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-18405a79-d5d3-44e4-8fcb-31b32b807584 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:51.132472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-18405a79-d5d3-44e4-8fcb-31b32b807584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:51.156027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c934e2b-d1c1-4d16-b4eb-9e5f114e797c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:51.157735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c934e2b-d1c1-4d16-b4eb-9e5f114e797c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:51.160231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:51.226850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 109/219] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:51.250504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18405a79-d5d3-44e4-8fcb-31b32b807584 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:51.286684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 111/220] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:51.294445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934e2b-d1c1-4d16-b4eb-9e5f114e797c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:51.361104 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18405a79-d5d3-44e4-8fcb-31b32b807584 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:51.381183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:51.406175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf330-b2f5-4ae0-b58d-f89bca14da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:51.406963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf330-b2f5-4ae0-b58d-f89bca14da14 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.407335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf330-b2f5-4ae0-b58d-f89bca14da14 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.407697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf330-b2f5-4ae0-b58d-f89bca14da14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:51.417923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934e2b-d1c1-4d16-b4eb-9e5f114e797c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:51.419837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:51.421982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdf330-b2f5-4ae0-b58d-f89bca14da14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-4ebdf330-b2f5-4ae0-b58d-f89bca14da14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:51.428592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:51.433511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:51.435078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 110/221] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:40:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:40:51.440090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf330-b2f5-4ae0-b58d-f89bca14da14 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:51.469095 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd7d5-d191-4a0f-8771-8b222ca5845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:51.470139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd7d5-d191-4a0f-8771-8b222ca5845b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.470607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd7d5-d191-4a0f-8771-8b222ca5845b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.471485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd7d5-d191-4a0f-8771-8b222ca5845b None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:51.472856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cd7d5-d191-4a0f-8771-8b222ca5845b None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:51.474603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cd7d5-d191-4a0f-8771-8b222ca5845b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:51.476467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 112/222] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:51 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:51.482538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd7d5-d191-4a0f-8771-8b222ca5845b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:51.576384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdf330-b2f5-4ae0-b58d-f89bca14da14 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:51.620745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d55e33-a141-4e73-baf6-81fa1040bd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:51.622122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55e33-a141-4e73-baf6-81fa1040bd5e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.622404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55e33-a141-4e73-baf6-81fa1040bd5e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.622675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55e33-a141-4e73-baf6-81fa1040bd5e None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:51.623346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d55e33-a141-4e73-baf6-81fa1040bd5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:51.623648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d55e33-a141-4e73-baf6-81fa1040bd5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:51.625030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d55e33-a141-4e73-baf6-81fa1040bd5e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:51.634825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 111/223] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:40:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:51.636545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b46496-6f57-45c0-9b03-be1bfff80e23 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.636652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b46496-6f57-45c0-9b03-be1bfff80e23 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.636851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b46496-6f57-45c0-9b03-be1bfff80e23 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:51.638103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 112/224] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:51.642906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b46496-6f57-45c0-9b03-be1bfff80e23 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:51.643486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd7d5-d191-4a0f-8771-8b222ca5845b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:51.681214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc1208-159c-451d-a529-6c762dc88618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:51.682236 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc1208-159c-451d-a529-6c762dc88618 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.682714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc1208-159c-451d-a529-6c762dc88618 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.683174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc1208-159c-451d-a529-6c762dc88618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:51.684087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc1208-159c-451d-a529-6c762dc88618 None admin] RBAC: Adding query filter params (role.id=ec8d0b12e5324b00bca50fea232c8690, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf, user.id=f6e4326eb3624a6ca5d03a1937b23113) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:51.684580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc1208-159c-451d-a529-6c762dc88618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:51.685948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:51.687558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc1208-159c-451d-a529-6c762dc88618 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:51.695374 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 113/225] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:51 2022] GET /identity/v3/role_assignments?user.id=f6e4326eb3624a6ca5d03a1937b23113&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:51.696919 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd9ae3-81fc-4179-8408-65c84a0e76b0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.697444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd9ae3-81fc-4179-8408-65c84a0e76b0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.697908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd9ae3-81fc-4179-8408-65c84a0e76b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:51.717593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-02bd9ae3-81fc-4179-8408-65c84a0e76b0 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:51.719316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-02bd9ae3-81fc-4179-8408-65c84a0e76b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:51.753170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:51.792382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b46496-6f57-45c0-9b03-be1bfff80e23 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:51.804110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 114/226] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:51.834005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd9ae3-81fc-4179-8408-65c84a0e76b0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:51.840029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198839bb-9fc5-45a2-962e-49685f5466ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:51.840786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198839bb-9fc5-45a2-962e-49685f5466ab None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.841066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198839bb-9fc5-45a2-962e-49685f5466ab None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.841357 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198839bb-9fc5-45a2-962e-49685f5466ab None admin] PATH_INFO: `/v3/users/fe30c68c376f4cd6884d906542041c69` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:51.842629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198839bb-9fc5-45a2-962e-49685f5466ab None admin] RBAC: Authorizing `identity:get_user(user_id=fe30c68c376f4cd6884d906542041c69)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:51.844182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198839bb-9fc5-45a2-962e-49685f5466ab None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:51.846623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 113/227] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:51 2022] GET /identity/v3/users/fe30c68c376f4cd6884d906542041c69 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:51.852354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198839bb-9fc5-45a2-962e-49685f5466ab None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:51.953689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd9ae3-81fc-4179-8408-65c84a0e76b0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:51.964796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198839bb-9fc5-45a2-962e-49685f5466ab None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:51.973534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:51.993914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdcc48-873f-4df1-b3f0-032ea3246563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:51.994826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdcc48-873f-4df1-b3f0-032ea3246563 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:51.995255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdcc48-873f-4df1-b3f0-032ea3246563 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:51.999366 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdcc48-873f-4df1-b3f0-032ea3246563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:52.004615 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a98aa-096a-40d8-a852-c523b1e818b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:52.005239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a98aa-096a-40d8-a852-c523b1e818b3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:52.005573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a98aa-096a-40d8-a852-c523b1e818b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:52.005844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a98aa-096a-40d8-a852-c523b1e818b3 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:52.006964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a98aa-096a-40d8-a852-c523b1e818b3 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:52.008370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdcc48-873f-4df1-b3f0-032ea3246563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:52.008489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a98aa-096a-40d8-a852-c523b1e818b3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:52.010392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 114/228] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:51 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-47bdcc48-873f-4df1-b3f0-032ea3246563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:52.014175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:52.015387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:52.016198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:52.017122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a98aa-096a-40d8-a852-c523b1e818b3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:52.019419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 115/229] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:40:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:52.025191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdcc48-873f-4df1-b3f0-032ea3246563 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:52.055039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:52.124963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a98aa-096a-40d8-a852-c523b1e818b3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:52.139219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdcc48-873f-4df1-b3f0-032ea3246563 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:52.159568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4386d-1915-4594-837b-fcfb0da56197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:52.160210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4386d-1915-4594-837b-fcfb0da56197 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:52.160483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4386d-1915-4594-837b-fcfb0da56197 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:52.160751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4386d-1915-4594-837b-fcfb0da56197 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/users/fe30c68c376f4cd6884d906542041c69/roles/6654493feb544c46aeca606d309a1af2` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:52.163507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4386d-1915-4594-837b-fcfb0da56197 None admin] RBAC: Authorizing `identity:create_grant(project_id=a25b4d45c4d04b1caa0854b2777fecbf, user_id=fe30c68c376f4cd6884d906542041c69, role_id=6654493feb544c46aeca606d309a1af2)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:52.165183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4386d-1915-4594-837b-fcfb0da56197 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:52.184348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ab2d-a78f-4f0f-a50d-9aa1b816b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:52.185867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ab2d-a78f-4f0f-a50d-9aa1b816b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:52.186361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ab2d-a78f-4f0f-a50d-9aa1b816b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:52.186821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ab2d-a78f-4f0f-a50d-9aa1b816b2d9 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:52.187676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9ab2d-a78f-4f0f-a50d-9aa1b816b2d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:52.188264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9ab2d-a78f-4f0f-a50d-9aa1b816b2d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:52.189950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9ab2d-a78f-4f0f-a50d-9aa1b816b2d9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:52.199644 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 116/230] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:52.206316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ab2d-a78f-4f0f-a50d-9aa1b816b2d9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:52.283800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 115/231] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:40:52 2022] PUT /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/users/fe30c68c376f4cd6884d906542041c69/roles/6654493feb544c46aeca606d309a1af2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:40:52.309809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:52.328134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ab2d-a78f-4f0f-a50d-9aa1b816b2d9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:52.375987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b15d5-808f-46d9-b35f-a7dce5987f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:52.376637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b15d5-808f-46d9-b35f-a7dce5987f21 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:52.376914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b15d5-808f-46d9-b35f-a7dce5987f21 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:52.377186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b15d5-808f-46d9-b35f-a7dce5987f21 None admin] PATH_INFO: `/v3/users/fe30c68c376f4cd6884d906542041c69` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:52.382266 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b15d5-808f-46d9-b35f-a7dce5987f21 None admin] RBAC: Authorizing `identity:get_user(user_id=fe30c68c376f4cd6884d906542041c69)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:52.383820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b15d5-808f-46d9-b35f-a7dce5987f21 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:52.386084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 117/232] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:52 2022] GET /identity/v3/users/fe30c68c376f4cd6884d906542041c69 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:52.391940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4386d-1915-4594-837b-fcfb0da56197 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:52.430986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:52.517675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4386d-1915-4594-837b-fcfb0da56197 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:52.577025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b7190-e7b7-49bf-8900-68e08f9da120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:52.577628 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7190-e7b7-49bf-8900-68e08f9da120 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:52.577901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7190-e7b7-49bf-8900-68e08f9da120 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:52.578167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7190-e7b7-49bf-8900-68e08f9da120 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:52.579296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b7190-e7b7-49bf-8900-68e08f9da120 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:52.580718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b7190-e7b7-49bf-8900-68e08f9da120 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:52.584049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 116/233] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:52 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:52.589645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b15d5-808f-46d9-b35f-a7dce5987f21 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:52.701861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b15d5-808f-46d9-b35f-a7dce5987f21 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:52.749074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb65875-b07d-457e-b759-2e63661d74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:52.749770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb65875-b07d-457e-b759-2e63661d74d4 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:52.750045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb65875-b07d-457e-b759-2e63661d74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:52.750321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb65875-b07d-457e-b759-2e63661d74d4 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/users/fe30c68c376f4cd6884d906542041c69/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:52.754832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb65875-b07d-457e-b759-2e63661d74d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a25b4d45c4d04b1caa0854b2777fecbf, user_id=fe30c68c376f4cd6884d906542041c69, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:52.756852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb65875-b07d-457e-b759-2e63661d74d4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:52.868567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 118/234] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:40:52 2022] PUT /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/users/fe30c68c376f4cd6884d906542041c69/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:40:53.441149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfca0a1-c976-4e16-a203-46b143e550bb None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:53.441712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfca0a1-c976-4e16-a203-46b143e550bb None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:53.441712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfca0a1-c976-4e16-a203-46b143e550bb None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:53.443430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 117/235] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:53.448390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c50c9-9064-44b1-bd6c-c26bcca9671d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:53.448817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c50c9-9064-44b1-bd6c-c26bcca9671d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:53.449009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c50c9-9064-44b1-bd6c-c26bcca9671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:53.474860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c86c50c9-9064-44b1-bd6c-c26bcca9671d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:53.476061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c86c50c9-9064-44b1-bd6c-c26bcca9671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:53.487168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:53.563619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 119/236] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:53.598847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfca0a1-c976-4e16-a203-46b143e550bb None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:53.718986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfca0a1-c976-4e16-a203-46b143e550bb None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:53.720876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:53.761623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4597781-7d82-4106-81bf-21363a3bb72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:53.762640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4597781-7d82-4106-81bf-21363a3bb72d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:53.763110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4597781-7d82-4106-81bf-21363a3bb72d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:53.763589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4597781-7d82-4106-81bf-21363a3bb72d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:53.775591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4597781-7d82-4106-81bf-21363a3bb72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d4597781-7d82-4106-81bf-21363a3bb72d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:53.780802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:53.781698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:40:53.782473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:53.785132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 118/237] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:53.792624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c50c9-9064-44b1-bd6c-c26bcca9671d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:53.916374 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c50c9-9064-44b1-bd6c-c26bcca9671d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:53.945813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803217c-9862-4464-9f89-a0418f2a4ec8 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:53.946095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803217c-9862-4464-9f89-a0418f2a4ec8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:53.946520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803217c-9862-4464-9f89-a0418f2a4ec8 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:53.948044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 119/238] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:40:53.957524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee46499-732c-4abc-bd17-f46faed7b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:53.958469 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46499-732c-4abc-bd17-f46faed7b0aa None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:53.958929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46499-732c-4abc-bd17-f46faed7b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:53.959373 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46499-732c-4abc-bd17-f46faed7b0aa None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:53.960218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee46499-732c-4abc-bd17-f46faed7b0aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:53.960692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee46499-732c-4abc-bd17-f46faed7b0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:53.962973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee46499-732c-4abc-bd17-f46faed7b0aa None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:53.968806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4abaf3-1cb2-4420-a278-b4d94a39473b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:53.969216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4abaf3-1cb2-4420-a278-b4d94a39473b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:53.969527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4abaf3-1cb2-4420-a278-b4d94a39473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:53.975174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 120/239] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:53.980772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee46499-732c-4abc-bd17-f46faed7b0aa None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:54.001636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:54.002205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7b4abaf3-1cb2-4420-a278-b4d94a39473b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:54.003417 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7b4abaf3-1cb2-4420-a278-b4d94a39473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:54.091744 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 120/240] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:54.108500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290273-4210-446a-8182-c2c4d37ee0c7 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.108822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290273-4210-446a-8182-c2c4d37ee0c7 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.109046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290273-4210-446a-8182-c2c4d37ee0c7 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.110561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 121/241] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:40:54.115856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe7d3f-16a2-4295-8a96-56a0535a3727 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.116137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe7d3f-16a2-4295-8a96-56a0535a3727 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.116409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe7d3f-16a2-4295-8a96-56a0535a3727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.134734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-8dfe7d3f-16a2-4295-8a96-56a0535a3727 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:54.135916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8dfe7d3f-16a2-4295-8a96-56a0535a3727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:54.162527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee46499-732c-4abc-bd17-f46faed7b0aa None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:54.202178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c964-540d-4370-9af4-5187f0c29a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:54.202811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c964-540d-4370-9af4-5187f0c29a9e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.203089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c964-540d-4370-9af4-5187f0c29a9e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.203361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c964-540d-4370-9af4-5187f0c29a9e None admin] PATH_INFO: `/v3/users/8036b5e4fcce4a6a9d29b329bd4cd9e3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.217463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3c964-540d-4370-9af4-5187f0c29a9e None admin] RBAC: Authorizing `identity:get_user(user_id=8036b5e4fcce4a6a9d29b329bd4cd9e3)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:54.218755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 122/242] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:54.218973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3c964-540d-4370-9af4-5187f0c29a9e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:54.219800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe7d3f-16a2-4295-8a96-56a0535a3727 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:54.225864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 121/243] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:53 2022] GET /identity/v3/users/8036b5e4fcce4a6a9d29b329bd4cd9e3 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:54.231180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c964-540d-4370-9af4-5187f0c29a9e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:54.265672 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:54.294640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:54.332582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c964-540d-4370-9af4-5187f0c29a9e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:54.340289 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe7d3f-16a2-4295-8a96-56a0535a3727 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:54.369712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35462fb5-9fd0-4909-9e51-d6fe0d73c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:54.370094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35462fb5-9fd0-4909-9e51-d6fe0d73c678 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.370370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35462fb5-9fd0-4909-9e51-d6fe0d73c678 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.370641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35462fb5-9fd0-4909-9e51-d6fe0d73c678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.381621 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22962e-e6e5-40bd-9f9c-3577c2557fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:54.382603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22962e-e6e5-40bd-9f9c-3577c2557fa1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.383067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22962e-e6e5-40bd-9f9c-3577c2557fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.383565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22962e-e6e5-40bd-9f9c-3577c2557fa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.384876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22962e-e6e5-40bd-9f9c-3577c2557fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:54.387443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22962e-e6e5-40bd-9f9c-3577c2557fa1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:54.390449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 123/244] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:54.391480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22962e-e6e5-40bd-9f9c-3577c2557fa1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:54.449282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35462fb5-9fd0-4909-9e51-d6fe0d73c678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:54.450841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35462fb5-9fd0-4909-9e51-d6fe0d73c678 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:54.503901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22962e-e6e5-40bd-9f9c-3577c2557fa1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:54.517104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:54.521762 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:54.542880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdcbb4-03d7-4b2b-8d3e-b251c97173c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:54.543913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdcbb4-03d7-4b2b-8d3e-b251c97173c5 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.556192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdcbb4-03d7-4b2b-8d3e-b251c97173c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.556669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdcbb4-03d7-4b2b-8d3e-b251c97173c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.562891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 122/245] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:54.563817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35462fb5-9fd0-4909-9e51-d6fe0d73c678 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:54.571667 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdcbb4-03d7-4b2b-8d3e-b251c97173c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-eefdcbb4-03d7-4b2b-8d3e-b251c97173c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:54.577043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:54.577941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:54.578804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:54.586225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 124/246] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:54.587609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdcbb4-03d7-4b2b-8d3e-b251c97173c5 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:54.667790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35462fb5-9fd0-4909-9e51-d6fe0d73c678 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:54.696381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdcbb4-03d7-4b2b-8d3e-b251c97173c5 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:54.702429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8510d8-16f2-4ebd-848d-9ca3fa319f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:54.703040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8510d8-16f2-4ebd-848d-9ca3fa319f26 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.703313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8510d8-16f2-4ebd-848d-9ca3fa319f26 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.703580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8510d8-16f2-4ebd-848d-9ca3fa319f26 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.704282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8510d8-16f2-4ebd-848d-9ca3fa319f26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:54.705786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8510d8-16f2-4ebd-848d-9ca3fa319f26 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:54.735320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24ae1c-4e0f-4766-b71f-391004cd2921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:54.736026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24ae1c-4e0f-4766-b71f-391004cd2921 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.736362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24ae1c-4e0f-4766-b71f-391004cd2921 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.736695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24ae1c-4e0f-4766-b71f-391004cd2921 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.737876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24ae1c-4e0f-4766-b71f-391004cd2921 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:54.739409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24ae1c-4e0f-4766-b71f-391004cd2921 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:54.745432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 125/247] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:54 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:54.745432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24ae1c-4e0f-4766-b71f-391004cd2921 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:54.769695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:54.796922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 123/248] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:40:54 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:54.798186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8510d8-16f2-4ebd-848d-9ca3fa319f26 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:54.829779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:54.866782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24ae1c-4e0f-4766-b71f-391004cd2921 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:54.911283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914cfd8-4c07-442c-abe1-9eec53588dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:54.912992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914cfd8-4c07-442c-abe1-9eec53588dd7 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.913497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914cfd8-4c07-442c-abe1-9eec53588dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.913981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914cfd8-4c07-442c-abe1-9eec53588dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.914943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914cfd8-4c07-442c-abe1-9eec53588dd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:54.915492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914cfd8-4c07-442c-abe1-9eec53588dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:54.917217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914cfd8-4c07-442c-abe1-9eec53588dd7 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:54.927372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 126/249] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:54.932821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8510d8-16f2-4ebd-848d-9ca3fa319f26 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:54.933413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914cfd8-4c07-442c-abe1-9eec53588dd7 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:54.979128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c84c2-8b99-4992-abfe-a8ceced980db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:54.979946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c84c2-8b99-4992-abfe-a8ceced980db None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.980323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c84c2-8b99-4992-abfe-a8ceced980db None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.980698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c84c2-8b99-4992-abfe-a8ceced980db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.981584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c84c2-8b99-4992-abfe-a8ceced980db None admin] RBAC: Adding query filter params (role.id=7a14ec7cc43c4b5fa0516c5d46f059db, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf, user.id=8036b5e4fcce4a6a9d29b329bd4cd9e3) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:54.981994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c84c2-8b99-4992-abfe-a8ceced980db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:54.983585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c84c2-8b99-4992-abfe-a8ceced980db None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:54.991897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 124/250] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:54 2022] GET /identity/v3/role_assignments?user.id=8036b5e4fcce4a6a9d29b329bd4cd9e3&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=7a14ec7cc43c4b5fa0516c5d46f059db => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:54.993409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ac158-1b70-4f91-b04c-038e7bdb9ce5 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:54.993875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ac158-1b70-4f91-b04c-038e7bdb9ce5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:54.994326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ac158-1b70-4f91-b04c-038e7bdb9ce5 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:54.996079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 125/251] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:55.001771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5959af-34f6-417c-996d-3b6222205d0b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:55.002048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5959af-34f6-417c-996d-3b6222205d0b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:55.002323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5959af-34f6-417c-996d-3b6222205d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:55.032005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4d5959af-34f6-417c-996d-3b6222205d0b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:55.033127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4d5959af-34f6-417c-996d-3b6222205d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:55.069707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:55.094853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914cfd8-4c07-442c-abe1-9eec53588dd7 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:55.142375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d941c-ae00-4b9c-a79b-03f780983362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:55.143294 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d941c-ae00-4b9c-a79b-03f780983362 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:55.143712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d941c-ae00-4b9c-a79b-03f780983362 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:55.144123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d941c-ae00-4b9c-a79b-03f780983362 None admin] PATH_INFO: `/v3/users/f6e4326eb3624a6ca5d03a1937b23113` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:55.145622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d941c-ae00-4b9c-a79b-03f780983362 None admin] RBAC: Authorizing `identity:get_user(user_id=f6e4326eb3624a6ca5d03a1937b23113)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:55.147299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d941c-ae00-4b9c-a79b-03f780983362 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:55.149148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 127/253] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:54 2022] GET /identity/v3/users/f6e4326eb3624a6ca5d03a1937b23113 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:55.153065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 126/253] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:55.155177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d941c-ae00-4b9c-a79b-03f780983362 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:55.174037 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5959af-34f6-417c-996d-3b6222205d0b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:55.201765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:55.292094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d941c-ae00-4b9c-a79b-03f780983362 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:55.331122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5959af-34f6-417c-996d-3b6222205d0b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:55.342265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250684f-8a19-4762-bf2b-2a3ccbe2c3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:55.342900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250684f-8a19-4762-bf2b-2a3ccbe2c3f3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:55.343175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250684f-8a19-4762-bf2b-2a3ccbe2c3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:55.343820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250684f-8a19-4762-bf2b-2a3ccbe2c3f3 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:55.344974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250684f-8a19-4762-bf2b-2a3ccbe2c3f3 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:55.350676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250684f-8a19-4762-bf2b-2a3ccbe2c3f3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:55.350832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 128/254] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:55 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:55.360337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250684f-8a19-4762-bf2b-2a3ccbe2c3f3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:55.403834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:55.406855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2b82f-6e88-4969-af63-97b34f8a74be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:55.407551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2b82f-6e88-4969-af63-97b34f8a74be None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:55.407832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2b82f-6e88-4969-af63-97b34f8a74be None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:55.408101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2b82f-6e88-4969-af63-97b34f8a74be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:55.441319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2b82f-6e88-4969-af63-97b34f8a74be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-aaa2b82f-6e88-4969-af63-97b34f8a74be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:55.444691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:55.446054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:40:55.447313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:55.448500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 127/255] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:40:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:40:55.455262 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2b82f-6e88-4969-af63-97b34f8a74be None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:55.536627 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250684f-8a19-4762-bf2b-2a3ccbe2c3f3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:55.582223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54820ea1-6912-4ba2-8dad-d0fafd7f07f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:55.582904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820ea1-6912-4ba2-8dad-d0fafd7f07f0 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:55.583181 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820ea1-6912-4ba2-8dad-d0fafd7f07f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:55.583985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54820ea1-6912-4ba2-8dad-d0fafd7f07f0 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/users/f6e4326eb3624a6ca5d03a1937b23113/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:55.586043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54820ea1-6912-4ba2-8dad-d0fafd7f07f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a25b4d45c4d04b1caa0854b2777fecbf, user_id=f6e4326eb3624a6ca5d03a1937b23113, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:55.588127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54820ea1-6912-4ba2-8dad-d0fafd7f07f0 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:55.612029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:55.648368 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2b82f-6e88-4969-af63-97b34f8a74be None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:55.687803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 129/256] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:40:55 2022] PUT /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/users/f6e4326eb3624a6ca5d03a1937b23113/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:40:55.688914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f378a-52c1-4575-a806-0b7f9bfab441 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:55.689195 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f378a-52c1-4575-a806-0b7f9bfab441 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:55.689495 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f378a-52c1-4575-a806-0b7f9bfab441 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:55.695876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 130/257] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:55.701740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87090c-6a93-415b-8115-fdc6747ba9b9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:55.702886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87090c-6a93-415b-8115-fdc6747ba9b9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:55.703161 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87090c-6a93-415b-8115-fdc6747ba9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:55.755258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-bc87090c-6a93-415b-8115-fdc6747ba9b9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:55.758797 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bc87090c-6a93-415b-8115-fdc6747ba9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:55.777038 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e633600-8fd8-4ef9-b89c-f384e0410a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:55.777702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e633600-8fd8-4ef9-b89c-f384e0410a75 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:55.781314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e633600-8fd8-4ef9-b89c-f384e0410a75 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:55.781314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e633600-8fd8-4ef9-b89c-f384e0410a75 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:55.781314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e633600-8fd8-4ef9-b89c-f384e0410a75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:55.781314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e633600-8fd8-4ef9-b89c-f384e0410a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:55.781314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e633600-8fd8-4ef9-b89c-f384e0410a75 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:55.828404 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 128/258] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:40:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:55.834621 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e633600-8fd8-4ef9-b89c-f384e0410a75 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:56.009528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 131/259] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:56.048923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87090c-6a93-415b-8115-fdc6747ba9b9 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:56.061768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:56.107647 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e633600-8fd8-4ef9-b89c-f384e0410a75 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:56.170367 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1596-9881-4579-a973-c942ce7e3d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:56.171308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1596-9881-4579-a973-c942ce7e3d8b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:56.171726 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1596-9881-4579-a973-c942ce7e3d8b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:56.172163 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1596-9881-4579-a973-c942ce7e3d8b None admin] PATH_INFO: `/v3/users/fe30c68c376f4cd6884d906542041c69` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:56.174841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b1596-9881-4579-a973-c942ce7e3d8b None admin] RBAC: Authorizing `identity:get_user(user_id=fe30c68c376f4cd6884d906542041c69)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:56.176572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b1596-9881-4579-a973-c942ce7e3d8b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:56.179065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 129/260] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:55 2022] GET /identity/v3/users/fe30c68c376f4cd6884d906542041c69 => generated 283 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:56.184993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1596-9881-4579-a973-c942ce7e3d8b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:56.197752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87090c-6a93-415b-8115-fdc6747ba9b9 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:56.197962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:56.233144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7575c-3af6-480e-b5e0-08e1c86fe7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:56.233938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7575c-3af6-480e-b5e0-08e1c86fe7a6 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:56.234215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7575c-3af6-480e-b5e0-08e1c86fe7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:56.234480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7575c-3af6-480e-b5e0-08e1c86fe7a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:56.245658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7575c-3af6-480e-b5e0-08e1c86fe7a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-aec7575c-3af6-480e-b5e0-08e1c86fe7a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:56.251460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:56.252350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:56.253133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 132/261] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:56.262125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7575c-3af6-480e-b5e0-08e1c86fe7a6 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:56.375733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:56.396477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1596-9881-4579-a973-c942ce7e3d8b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:56.449097 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7575c-3af6-480e-b5e0-08e1c86fe7a6 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:56.467269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceec09-e982-41d7-922c-3b5b29e698bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:56.467906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceec09-e982-41d7-922c-3b5b29e698bf None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:56.468121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceec09-e982-41d7-922c-3b5b29e698bf None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:56.468387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ceec09-e982-41d7-922c-3b5b29e698bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:56.520838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29272ae-71da-4575-879e-58b4ec7e46d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:56.521508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29272ae-71da-4575-879e-58b4ec7e46d4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:56.521902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29272ae-71da-4575-879e-58b4ec7e46d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:56.522314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29272ae-71da-4575-879e-58b4ec7e46d4 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:56.522993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29272ae-71da-4575-879e-58b4ec7e46d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:56.523296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29272ae-71da-4575-879e-58b4ec7e46d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:56.524762 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29272ae-71da-4575-879e-58b4ec7e46d4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:56.533986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 133/262] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:56.540095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29272ae-71da-4575-879e-58b4ec7e46d4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:56.636860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ceec09-e982-41d7-922c-3b5b29e698bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:56.639459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ceec09-e982-41d7-922c-3b5b29e698bf None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:56.646972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:56.761357 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29272ae-71da-4575-879e-58b4ec7e46d4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:56.792024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:56.800723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07824efd-0692-4f44-8559-7cb14765da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:56.801466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07824efd-0692-4f44-8559-7cb14765da32 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:56.805061 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07824efd-0692-4f44-8559-7cb14765da32 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:56.805061 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07824efd-0692-4f44-8559-7cb14765da32 None admin] PATH_INFO: `/v3/users/fe30c68c376f4cd6884d906542041c69` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:56.805061 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07824efd-0692-4f44-8559-7cb14765da32 None admin] RBAC: Authorizing `identity:get_user(user_id=fe30c68c376f4cd6884d906542041c69)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:56.805613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07824efd-0692-4f44-8559-7cb14765da32 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:56.807529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 134/263] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:56 2022] GET /identity/v3/users/fe30c68c376f4cd6884d906542041c69 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:56.814231 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07824efd-0692-4f44-8559-7cb14765da32 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:56.872436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 130/264] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:56.877758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceec09-e982-41d7-922c-3b5b29e698bf None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:56.979128 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07824efd-0692-4f44-8559-7cb14765da32 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:57.038130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb7a4d-2c55-4b8d-aede-80fb99162231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:57.038759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7a4d-2c55-4b8d-aede-80fb99162231 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:57.039040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7a4d-2c55-4b8d-aede-80fb99162231 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:57.039309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb7a4d-2c55-4b8d-aede-80fb99162231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:57.137676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:57.142406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb7a4d-2c55-4b8d-aede-80fb99162231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:57.143912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb7a4d-2c55-4b8d-aede-80fb99162231 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:57.159276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ceec09-e982-41d7-922c-3b5b29e698bf None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:57.166330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:57.252559 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 135/265] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:40:57.259211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb7a4d-2c55-4b8d-aede-80fb99162231 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:57.264867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c739c9-623b-4de7-ab3e-d556f687fc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:57.265520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c739c9-623b-4de7-ab3e-d556f687fc80 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:57.265795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c739c9-623b-4de7-ab3e-d556f687fc80 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:57.266058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c739c9-623b-4de7-ab3e-d556f687fc80 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:57.267179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c739c9-623b-4de7-ab3e-d556f687fc80 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:57.268599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c739c9-623b-4de7-ab3e-d556f687fc80 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:57.270520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 131/266] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:56 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:57.282433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c739c9-623b-4de7-ab3e-d556f687fc80 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:57.367382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:57.373612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb7a4d-2c55-4b8d-aede-80fb99162231 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:57.412417 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3cd89-82f9-49b1-a2a2-8f854633367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:57.413255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3cd89-82f9-49b1-a2a2-8f854633367b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:57.417554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3cd89-82f9-49b1-a2a2-8f854633367b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:57.417554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3cd89-82f9-49b1-a2a2-8f854633367b None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:57.422370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3cd89-82f9-49b1-a2a2-8f854633367b None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:57.424010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3cd89-82f9-49b1-a2a2-8f854633367b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:57.426329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 136/267] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:57 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:57.431832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3cd89-82f9-49b1-a2a2-8f854633367b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:57.487707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c739c9-623b-4de7-ab3e-d556f687fc80 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:57.580825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec6a71-acdf-4943-919f-16463542c76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:57.581473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6a71-acdf-4943-919f-16463542c76a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:57.581754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6a71-acdf-4943-919f-16463542c76a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:57.582027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6a71-acdf-4943-919f-16463542c76a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:57.582767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec6a71-acdf-4943-919f-16463542c76a None admin] RBAC: Adding query filter params (role.id=6654493feb544c46aeca606d309a1af2, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf, user.id=fe30c68c376f4cd6884d906542041c69) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:57.583073 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec6a71-acdf-4943-919f-16463542c76a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:57.585099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec6a71-acdf-4943-919f-16463542c76a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:57.607652 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 132/268] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:57 2022] GET /identity/v3/role_assignments?user.id=fe30c68c376f4cd6884d906542041c69&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=6654493feb544c46aeca606d309a1af2 => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:57.644815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3cd89-82f9-49b1-a2a2-8f854633367b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:57.694720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0b279-295d-4053-8329-efbe2f4cbf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:57.695343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0b279-295d-4053-8329-efbe2f4cbf49 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:57.695619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0b279-295d-4053-8329-efbe2f4cbf49 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:57.695889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0b279-295d-4053-8329-efbe2f4cbf49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:57.696638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0b279-295d-4053-8329-efbe2f4cbf49 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf, user.id=fe30c68c376f4cd6884d906542041c69) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:57.696943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0b279-295d-4053-8329-efbe2f4cbf49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:57.698463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0b279-295d-4053-8329-efbe2f4cbf49 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:57.705574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 137/269] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:40:57 2022] GET /identity/v3/role_assignments?user.id=fe30c68c376f4cd6884d906542041c69&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=edba0d8c079245a38a321d2d77d25419 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:57.710424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538940-d53a-45a6-b2f5-06b94361a6b0 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:57.710764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538940-d53a-45a6-b2f5-06b94361a6b0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:57.710969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538940-d53a-45a6-b2f5-06b94361a6b0 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:57.712802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 133/270] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:57.718635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349bb9e-baa8-41f7-bccd-31b8eadf9c18 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:57.719225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349bb9e-baa8-41f7-bccd-31b8eadf9c18 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:57.719714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349bb9e-baa8-41f7-bccd-31b8eadf9c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:57.747073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e349bb9e-baa8-41f7-bccd-31b8eadf9c18 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:57.748699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e349bb9e-baa8-41f7-bccd-31b8eadf9c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:57.786136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:57.848955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 138/271] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:40:57.892093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538940-d53a-45a6-b2f5-06b94361a6b0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:57.954581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:58.042001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538940-d53a-45a6-b2f5-06b94361a6b0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:58.088093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de072b2a-cf57-4641-9745-20e501ccb5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:58.088749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072b2a-cf57-4641-9745-20e501ccb5e4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.089026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072b2a-cf57-4641-9745-20e501ccb5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.089343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072b2a-cf57-4641-9745-20e501ccb5e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.101926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de072b2a-cf57-4641-9745-20e501ccb5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-de072b2a-cf57-4641-9745-20e501ccb5e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:58.107342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:58.108238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:58.108993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 134/272] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:58.114445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349bb9e-baa8-41f7-bccd-31b8eadf9c18 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:58.150651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984b28-b295-473a-a9e4-5d99bf7c2743 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.150949 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984b28-b295-473a-a9e4-5d99bf7c2743 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.151203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b984b28-b295-473a-a9e4-5d99bf7c2743 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.153518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 135/273] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:58.159006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5363-8aea-467d-b21f-f988b2e8ba6e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.159289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5363-8aea-467d-b21f-f988b2e8ba6e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.159562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5363-8aea-467d-b21f-f988b2e8ba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.180699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c10a5363-8aea-467d-b21f-f988b2e8ba6e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:58.183229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c10a5363-8aea-467d-b21f-f988b2e8ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:58.251695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349bb9e-baa8-41f7-bccd-31b8eadf9c18 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:58.272707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 136/274] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:58.291518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2b732-c9a6-4159-819d-14c245f18a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:58.292137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2b732-c9a6-4159-819d-14c245f18a4f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.292462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2b732-c9a6-4159-819d-14c245f18a4f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.292704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2b732-c9a6-4159-819d-14c245f18a4f None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.293369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2b732-c9a6-4159-819d-14c245f18a4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:58.293886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2b732-c9a6-4159-819d-14c245f18a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:58.295270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2b732-c9a6-4159-819d-14c245f18a4f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:58.299170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a5363-8aea-467d-b21f-f988b2e8ba6e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:58.310556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 139/275] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:58.316126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2b732-c9a6-4159-819d-14c245f18a4f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:58.345235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:58.346763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:58.438055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a5363-8aea-467d-b21f-f988b2e8ba6e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:58.448947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2b732-c9a6-4159-819d-14c245f18a4f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:58.482244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9ed8d-e317-4749-8af5-809744d9c073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:58.482867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9ed8d-e317-4749-8af5-809744d9c073 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.483147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9ed8d-e317-4749-8af5-809744d9c073 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.483419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9ed8d-e317-4749-8af5-809744d9c073 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.488640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6c00a-906a-470b-9fe8-49ef8b69bf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:58.489511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6c00a-906a-470b-9fe8-49ef8b69bf4a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.490324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6c00a-906a-470b-9fe8-49ef8b69bf4a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.490595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6c00a-906a-470b-9fe8-49ef8b69bf4a None admin] PATH_INFO: `/v3/users/8036b5e4fcce4a6a9d29b329bd4cd9e3` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.491804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6c00a-906a-470b-9fe8-49ef8b69bf4a None admin] RBAC: Authorizing `identity:get_user(user_id=8036b5e4fcce4a6a9d29b329bd4cd9e3)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:58.493160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6c00a-906a-470b-9fe8-49ef8b69bf4a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:58.494417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9ed8d-e317-4749-8af5-809744d9c073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:58.497421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 140/276] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:58 2022] GET /identity/v3/users/8036b5e4fcce4a6a9d29b329bd4cd9e3 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:58.498844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8f3e4-789a-4423-8632-a96b3a43e738 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-97a9ed8d-e317-4749-8af5-809744d9c073 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:58.499209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:58.500046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 137/277] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:58.506724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9ed8d-e317-4749-8af5-809744d9c073 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:58.507461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8f3e4-789a-4423-8632-a96b3a43e738 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.507461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8f3e4-789a-4423-8632-a96b3a43e738 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.507461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 141/278] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:58.510409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8f3e4-789a-4423-8632-a96b3a43e738 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:58.596761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:58.610070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:58.612468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9ed8d-e317-4749-8af5-809744d9c073 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:58.622690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8f3e4-789a-4423-8632-a96b3a43e738 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:58.649527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740ae8f-f353-47da-9bb9-9a11265d7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:58.650278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740ae8f-f353-47da-9bb9-9a11265d7e05 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.650497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740ae8f-f353-47da-9bb9-9a11265d7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.650684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740ae8f-f353-47da-9bb9-9a11265d7e05 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.651866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740ae8f-f353-47da-9bb9-9a11265d7e05 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:58.653328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740ae8f-f353-47da-9bb9-9a11265d7e05 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:58.655271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 138/279] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:40:58 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:58.656414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319a8f6-263c-439d-aa84-7b3c779d9de6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.656687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319a8f6-263c-439d-aa84-7b3c779d9de6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.656957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319a8f6-263c-439d-aa84-7b3c779d9de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.662291 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4c815-5b83-47fb-a48e-7cafde6a42bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:58.663477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4c815-5b83-47fb-a48e-7cafde6a42bb None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.663889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4c815-5b83-47fb-a48e-7cafde6a42bb None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.664300 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4c815-5b83-47fb-a48e-7cafde6a42bb None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.664963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4c815-5b83-47fb-a48e-7cafde6a42bb None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:58.665266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4c815-5b83-47fb-a48e-7cafde6a42bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:58.666961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4c815-5b83-47fb-a48e-7cafde6a42bb None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:58.675184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9319a8f6-263c-439d-aa84-7b3c779d9de6 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:58.676349 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9319a8f6-263c-439d-aa84-7b3c779d9de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:58.677951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 142/280] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:58.683410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4c815-5b83-47fb-a48e-7cafde6a42bb None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:58.746709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 139/281] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:58.747392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319a8f6-263c-439d-aa84-7b3c779d9de6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:58.794353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4c815-5b83-47fb-a48e-7cafde6a42bb None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:58.828884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4bf83-5e4f-46c7-b12d-2db80e2d6fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:58.829570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4bf83-5e4f-46c7-b12d-2db80e2d6fdc None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.829846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4bf83-5e4f-46c7-b12d-2db80e2d6fdc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.830119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4bf83-5e4f-46c7-b12d-2db80e2d6fdc None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/users/8036b5e4fcce4a6a9d29b329bd4cd9e3/roles/7a14ec7cc43c4b5fa0516c5d46f059db` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.832053 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4bf83-5e4f-46c7-b12d-2db80e2d6fdc None admin] RBAC: Authorizing `identity:create_grant(project_id=a25b4d45c4d04b1caa0854b2777fecbf, user_id=8036b5e4fcce4a6a9d29b329bd4cd9e3, role_id=7a14ec7cc43c4b5fa0516c5d46f059db)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:58.833541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4bf83-5e4f-46c7-b12d-2db80e2d6fdc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:58.842452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:58.858607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319a8f6-263c-439d-aa84-7b3c779d9de6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:58.892349 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4068609-1494-498a-857e-968a813dc506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:58.892988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4068609-1494-498a-857e-968a813dc506 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.893264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4068609-1494-498a-857e-968a813dc506 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.893565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4068609-1494-498a-857e-968a813dc506 None admin] PATH_INFO: `/v3/users/38b4c736ccd649fea497a5f8f31c8dca` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.896879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 143/282] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:40:58 2022] PUT /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/users/8036b5e4fcce4a6a9d29b329bd4cd9e3/roles/7a14ec7cc43c4b5fa0516c5d46f059db => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:40:58.897972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022fe61-659f-44a0-80ed-6e42cbc55619 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.898257 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022fe61-659f-44a0-80ed-6e42cbc55619 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.898527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022fe61-659f-44a0-80ed-6e42cbc55619 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.899775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 144/283] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:40:58.900477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022fe61-659f-44a0-80ed-6e42cbc55619 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:58.916157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:58.921744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4068609-1494-498a-857e-968a813dc506 None admin] RBAC: Authorizing `identity:get_user(user_id=38b4c736ccd649fea497a5f8f31c8dca)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:58.923498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4068609-1494-498a-857e-968a813dc506 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:58.925444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 140/284] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:58 2022] GET /identity/v3/users/38b4c736ccd649fea497a5f8f31c8dca => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:58.932244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc919f71-dc4d-4368-bae0-39301e40ba76 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:58.932522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc919f71-dc4d-4368-bae0-39301e40ba76 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:58.932734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc919f71-dc4d-4368-bae0-39301e40ba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:58.951673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fc919f71-dc4d-4368-bae0-39301e40ba76 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:40:58.952918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fc919f71-dc4d-4368-bae0-39301e40ba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:40:59.024288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022fe61-659f-44a0-80ed-6e42cbc55619 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:59.035005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 141/285] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:40:59.035005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc919f71-dc4d-4368-bae0-39301e40ba76 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:59.069595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1a7fc-bb35-4998-bf61-76d5633fd8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:59.070310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1a7fc-bb35-4998-bf61-76d5633fd8e3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:59.070591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1a7fc-bb35-4998-bf61-76d5633fd8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:59.070858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1a7fc-bb35-4998-bf61-76d5633fd8e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:59.071951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1a7fc-bb35-4998-bf61-76d5633fd8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:59.073412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1a7fc-bb35-4998-bf61-76d5633fd8e3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:59.074964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 145/286] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:40:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:59.075720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1a7fc-bb35-4998-bf61-76d5633fd8e3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:59.120636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:59.151006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc919f71-dc4d-4368-bae0-39301e40ba76 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:59.162520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:59.189060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1a7fc-bb35-4998-bf61-76d5633fd8e3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:59.190922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1539-6d5e-45db-9074-a1f3bfa53be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:59.191528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1539-6d5e-45db-9074-a1f3bfa53be5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:59.191804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1539-6d5e-45db-9074-a1f3bfa53be5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:59.192074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1539-6d5e-45db-9074-a1f3bfa53be5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:59.192815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e1539-6d5e-45db-9074-a1f3bfa53be5 None admin] RBAC: Adding query filter params (role.id=ec8d0b12e5324b00bca50fea232c8690, user.id=38b4c736ccd649fea497a5f8f31c8dca, scope.system=all) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:59.193133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e1539-6d5e-45db-9074-a1f3bfa53be5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:59.194608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e1539-6d5e-45db-9074-a1f3bfa53be5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:59.199750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 142/287] 10.222.0.77 () {56 vars in 1308 bytes} [Wed Aug 10 22:40:59 2022] GET /identity/v3/role_assignments?user.id=38b4c736ccd649fea497a5f8f31c8dca&scope.system=all&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:59.200521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1539-6d5e-45db-9074-a1f3bfa53be5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:59.250693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169168d-af8f-41a3-a1f4-da5f80c54fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:59.252104 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169168d-af8f-41a3-a1f4-da5f80c54fa8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:59.252890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169168d-af8f-41a3-a1f4-da5f80c54fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:59.253413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169168d-af8f-41a3-a1f4-da5f80c54fa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:59.269702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169168d-af8f-41a3-a1f4-da5f80c54fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-1169168d-af8f-41a3-a1f4-da5f80c54fa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:40:59.278206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:40:59.279101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:40:59.279876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:40:59.282918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 146/288] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:40:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:40:59.289564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169168d-af8f-41a3-a1f4-da5f80c54fa8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:59.328819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1539-6d5e-45db-9074-a1f3bfa53be5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:59.373057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d9578-fc17-42a6-9456-0589d92e50de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:59.373703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d9578-fc17-42a6-9456-0589d92e50de None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:59.373978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d9578-fc17-42a6-9456-0589d92e50de None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:59.374247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d9578-fc17-42a6-9456-0589d92e50de None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:59.374887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d9578-fc17-42a6-9456-0589d92e50de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:59.376447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d9578-fc17-42a6-9456-0589d92e50de None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:59.387488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:59.433858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169168d-af8f-41a3-a1f4-da5f80c54fa8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:59.468919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed901021-8a13-485f-ac33-b24d0be66f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:59.469559 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901021-8a13-485f-ac33-b24d0be66f2a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:59.469832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901021-8a13-485f-ac33-b24d0be66f2a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:59.470162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed901021-8a13-485f-ac33-b24d0be66f2a None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:59.470755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901021-8a13-485f-ac33-b24d0be66f2a None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:40:59.471048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901021-8a13-485f-ac33-b24d0be66f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:59.473001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed901021-8a13-485f-ac33-b24d0be66f2a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:59.479671 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:59.484367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 147/289] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:40:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:40:59.489604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed901021-8a13-485f-ac33-b24d0be66f2a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:59.515123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 143/290] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:40:59 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:40:59.611989 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed901021-8a13-485f-ac33-b24d0be66f2a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:59.652299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c691-9117-420b-a9c8-57d1eda786a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:59.653422 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c691-9117-420b-a9c8-57d1eda786a0 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:59.653924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c691-9117-420b-a9c8-57d1eda786a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:59.654384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c691-9117-420b-a9c8-57d1eda786a0 None admin] PATH_INFO: `/v3/users/f6e4326eb3624a6ca5d03a1937b23113` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:59.656004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2c691-9117-420b-a9c8-57d1eda786a0 None admin] RBAC: Authorizing `identity:get_user(user_id=f6e4326eb3624a6ca5d03a1937b23113)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:59.657818 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2c691-9117-420b-a9c8-57d1eda786a0 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:40:59.660234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 148/291] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:40:59 2022] GET /identity/v3/users/f6e4326eb3624a6ca5d03a1937b23113 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:40:59.666452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d9578-fc17-42a6-9456-0589d92e50de None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:40:59.777044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d9578-fc17-42a6-9456-0589d92e50de None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:40:59.811606 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0654d-a474-45df-981a-520512061915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:40:59.812212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0654d-a474-45df-981a-520512061915 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:40:59.812489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0654d-a474-45df-981a-520512061915 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:40:59.812803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0654d-a474-45df-981a-520512061915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:40:59.880003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:40:59.891212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0654d-a474-45df-981a-520512061915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:40:59.892607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0654d-a474-45df-981a-520512061915 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:00.001816 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 144/292] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:00.007771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c691-9117-420b-a9c8-57d1eda786a0 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:00.079793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:00.114501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c691-9117-420b-a9c8-57d1eda786a0 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:00.151299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d8a00-9bfc-4b84-802b-22eb1a44845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:00.152263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d8a00-9bfc-4b84-802b-22eb1a44845f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:00.152750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d8a00-9bfc-4b84-802b-22eb1a44845f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:00.153211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d8a00-9bfc-4b84-802b-22eb1a44845f None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:00.154544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d8a00-9bfc-4b84-802b-22eb1a44845f None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:00.156148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d8a00-9bfc-4b84-802b-22eb1a44845f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:00.158352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 149/293] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:00 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:00.166458 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0654d-a474-45df-981a-520512061915 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:00.269658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:00.277468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0654d-a474-45df-981a-520512061915 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:00.313733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c2e9-8327-43b2-a700-cf85cbc9a731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:00.314389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c2e9-8327-43b2-a700-cf85cbc9a731 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:00.314667 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c2e9-8327-43b2-a700-cf85cbc9a731 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:00.314988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c2e9-8327-43b2-a700-cf85cbc9a731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:00.315723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6c2e9-8327-43b2-a700-cf85cbc9a731 None admin] RBAC: Adding query filter params (role.id=ec8d0b12e5324b00bca50fea232c8690, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf, user.id=f6e4326eb3624a6ca5d03a1937b23113) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:00.316028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6c2e9-8327-43b2-a700-cf85cbc9a731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:00.317500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6c2e9-8327-43b2-a700-cf85cbc9a731 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:00.324063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 145/294] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:00 2022] GET /identity/v3/role_assignments?user.id=f6e4326eb3624a6ca5d03a1937b23113&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:01.116477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2853-c75f-43e6-95d9-1e01082523d4 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:01.116973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2853-c75f-43e6-95d9-1e01082523d4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:01.117046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d2853-c75f-43e6-95d9-1e01082523d4 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:01.118667 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 150/295] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:01.124237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d164-9c22-47dd-8cd2-786b3f07dd82 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:01.125058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d164-9c22-47dd-8cd2-786b3f07dd82 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:01.125545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d164-9c22-47dd-8cd2-786b3f07dd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:01.147424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6395d164-9c22-47dd-8cd2-786b3f07dd82 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:01.148609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6395d164-9c22-47dd-8cd2-786b3f07dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:01.229952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 146/296] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:41:01.252224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d2853-c75f-43e6-95d9-1e01082523d4 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:01.329576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f64e6-7705-467b-b50c-394da8508292 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:01.330196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f64e6-7705-467b-b50c-394da8508292 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:01.330656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f64e6-7705-467b-b50c-394da8508292 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:01.332466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 147/297] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:01.338217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797caed-5d69-4179-8fa1-a26296d80ca3 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:01.338736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797caed-5d69-4179-8fa1-a26296d80ca3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:01.339196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797caed-5d69-4179-8fa1-a26296d80ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:01.357646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1797caed-5d69-4179-8fa1-a26296d80ca3 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:01.359166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1797caed-5d69-4179-8fa1-a26296d80ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:01.369393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d2853-c75f-43e6-95d9-1e01082523d4 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:01.415483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26109-93df-412e-b0af-de29b2d25c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:01.416113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26109-93df-412e-b0af-de29b2d25c4e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:01.416386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26109-93df-412e-b0af-de29b2d25c4e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:01.416651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26109-93df-412e-b0af-de29b2d25c4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:01.420138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:01.431691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e26109-93df-412e-b0af-de29b2d25c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-29e26109-93df-412e-b0af-de29b2d25c4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:01.441338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:01.442251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:01.443598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 151/299] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:01.444853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26109-93df-412e-b0af-de29b2d25c4e None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:01.445059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 148/299] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:41:01.461544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797caed-5d69-4179-8fa1-a26296d80ca3 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:01.480233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:01.584872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26109-93df-412e-b0af-de29b2d25c4e None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:01.585863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797caed-5d69-4179-8fa1-a26296d80ca3 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:01.623366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40dc8-3ee7-4a96-a57c-b428218428de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:01.624314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40dc8-3ee7-4a96-a57c-b428218428de None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:01.625040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40dc8-3ee7-4a96-a57c-b428218428de None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:01.625610 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40dc8-3ee7-4a96-a57c-b428218428de None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:01.626460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40dc8-3ee7-4a96-a57c-b428218428de None admin] RBAC: Adding query filter params (name=reader) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:01.626993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40dc8-3ee7-4a96-a57c-b428218428de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:01.628551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40dc8-3ee7-4a96-a57c-b428218428de None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:01.630943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d27a8-cf46-4bbf-8382-67f9bd13c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:01.631596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d27a8-cf46-4bbf-8382-67f9bd13c215 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:01.631874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d27a8-cf46-4bbf-8382-67f9bd13c215 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:01.632146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d27a8-cf46-4bbf-8382-67f9bd13c215 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:01.639680 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 152/300] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:01.645282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40dc8-3ee7-4a96-a57c-b428218428de None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:01.650654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d27a8-cf46-4bbf-8382-67f9bd13c215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-135d27a8-cf46-4bbf-8382-67f9bd13c215 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:01.655478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:01.656385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:01.657148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 149/301] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:01.663588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d27a8-cf46-4bbf-8382-67f9bd13c215 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:01.729670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:01.755079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:01.777168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40dc8-3ee7-4a96-a57c-b428218428de None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:01.784713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d27a8-cf46-4bbf-8382-67f9bd13c215 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:01.817653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49bcb-8c39-4ad5-be5f-40abf7e97970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:01.818920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49bcb-8c39-4ad5-be5f-40abf7e97970 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:01.819396 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49bcb-8c39-4ad5-be5f-40abf7e97970 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:01.819896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49bcb-8c39-4ad5-be5f-40abf7e97970 None admin] PATH_INFO: `/v3/users/8036b5e4fcce4a6a9d29b329bd4cd9e3` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:01.821223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49bcb-8c39-4ad5-be5f-40abf7e97970 None admin] RBAC: Authorizing `identity:get_user(user_id=8036b5e4fcce4a6a9d29b329bd4cd9e3)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:01.823145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49bcb-8c39-4ad5-be5f-40abf7e97970 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:01.825738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 153/302] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:41:01 2022] GET /identity/v3/users/8036b5e4fcce4a6a9d29b329bd4cd9e3 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:01.831076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1694c-758e-4a75-bc53-c90a3716007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:01.831356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49bcb-8c39-4ad5-be5f-40abf7e97970 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:01.832240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1694c-758e-4a75-bc53-c90a3716007a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:01.832723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1694c-758e-4a75-bc53-c90a3716007a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:01.833223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1694c-758e-4a75-bc53-c90a3716007a None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:01.834542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1694c-758e-4a75-bc53-c90a3716007a None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:01.836086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1694c-758e-4a75-bc53-c90a3716007a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:01.837780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1694c-758e-4a75-bc53-c90a3716007a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:01.857551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 150/303] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:01.859426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1694c-758e-4a75-bc53-c90a3716007a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:01.959180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49bcb-8c39-4ad5-be5f-40abf7e97970 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:01.988830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:01.994658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1694c-758e-4a75-bc53-c90a3716007a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:01.999853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3094b-582c-4850-9564-2952ab681373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:02.000511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3094b-582c-4850-9564-2952ab681373 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.000790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3094b-582c-4850-9564-2952ab681373 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.001057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3094b-582c-4850-9564-2952ab681373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.032218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3084e9c-8e14-4341-b1b7-ffa06f7ae16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:02.033230 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084e9c-8e14-4341-b1b7-ffa06f7ae16a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.033779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084e9c-8e14-4341-b1b7-ffa06f7ae16a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.034236 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084e9c-8e14-4341-b1b7-ffa06f7ae16a None admin] PATH_INFO: `/v3/users/38b4c736ccd649fea497a5f8f31c8dca` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.035603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3084e9c-8e14-4341-b1b7-ffa06f7ae16a None admin] RBAC: Authorizing `identity:get_user(user_id=38b4c736ccd649fea497a5f8f31c8dca)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:02.037858 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3084e9c-8e14-4341-b1b7-ffa06f7ae16a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:02.039636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 151/304] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:41:01 2022] GET /identity/v3/users/38b4c736ccd649fea497a5f8f31c8dca => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:02.045810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e28f2-8d2d-455e-879a-a194809ab426 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.046093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e28f2-8d2d-455e-879a-a194809ab426 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.046360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e28f2-8d2d-455e-879a-a194809ab426 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.047639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 152/305] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:02.048757 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e28f2-8d2d-455e-879a-a194809ab426 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:02.058043 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:02.086214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3094b-582c-4850-9564-2952ab681373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:02.087666 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3094b-582c-4850-9564-2952ab681373 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:02.155945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e28f2-8d2d-455e-879a-a194809ab426 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:02.190825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbad732-b5ee-4d40-a74f-26841568758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:02.191484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad732-b5ee-4d40-a74f-26841568758a None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.191761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad732-b5ee-4d40-a74f-26841568758a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.192034 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad732-b5ee-4d40-a74f-26841568758a None admin] PATH_INFO: `/v3/system/users/38b4c736ccd649fea497a5f8f31c8dca/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.192513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 154/306] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:02.194474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13dab8-3943-41f9-ad83-31650f9571df None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.194658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbad732-b5ee-4d40-a74f-26841568758a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=38b4c736ccd649fea497a5f8f31c8dca, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:02.194988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13dab8-3943-41f9-ad83-31650f9571df None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.195416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13dab8-3943-41f9-ad83-31650f9571df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.196042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbad732-b5ee-4d40-a74f-26841568758a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:02.232111 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-2e13dab8-3943-41f9-ad83-31650f9571df None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:02.232111 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2e13dab8-3943-41f9-ad83-31650f9571df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:02.235763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:02.279096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 155/307] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:02.280286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4856ef-0a96-4431-94d4-2c72c828ccc1 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.280559 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4856ef-0a96-4431-94d4-2c72c828ccc1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.280825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4856ef-0a96-4431-94d4-2c72c828ccc1 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.282074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 156/308] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:02.286147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4856ef-0a96-4431-94d4-2c72c828ccc1 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:02.314196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 153/309] 10.222.0.77 () {58 vars in 1334 bytes} [Wed Aug 10 22:41:02 2022] PUT /identity/v3/system/users/38b4c736ccd649fea497a5f8f31c8dca/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:02.315649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4ceb-f2e1-4944-9e95-c5f98cd27dbe None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.316000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4ceb-f2e1-4944-9e95-c5f98cd27dbe None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.316276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4ceb-f2e1-4944-9e95-c5f98cd27dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.336562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-effe4ceb-f2e1-4944-9e95-c5f98cd27dbe None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:02.337815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-effe4ceb-f2e1-4944-9e95-c5f98cd27dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:02.398514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4856ef-0a96-4431-94d4-2c72c828ccc1 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:02.410903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:02.417368 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 154/310] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:02.418666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4ceb-f2e1-4944-9e95-c5f98cd27dbe None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:02.448736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabcd13-ac12-42ac-b10e-3f0a54cea9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:02.449497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabcd13-ac12-42ac-b10e-3f0a54cea9d4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.449853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabcd13-ac12-42ac-b10e-3f0a54cea9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.450283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabcd13-ac12-42ac-b10e-3f0a54cea9d4 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.451565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabcd13-ac12-42ac-b10e-3f0a54cea9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:02.453093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabcd13-ac12-42ac-b10e-3f0a54cea9d4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:02.460114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 157/311] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:02 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:02.460114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabcd13-ac12-42ac-b10e-3f0a54cea9d4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:02.482717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:02.542660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4ceb-f2e1-4944-9e95-c5f98cd27dbe None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:02.569837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabcd13-ac12-42ac-b10e-3f0a54cea9d4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:02.579843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114120bb-73c2-48f3-996f-4b9e4ab71b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:02.580548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114120bb-73c2-48f3-996f-4b9e4ab71b20 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.580741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114120bb-73c2-48f3-996f-4b9e4ab71b20 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.580994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114120bb-73c2-48f3-996f-4b9e4ab71b20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.592749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114120bb-73c2-48f3-996f-4b9e4ab71b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-114120bb-73c2-48f3-996f-4b9e4ab71b20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:02.597478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:02.598356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 155/312] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:02.599475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114120bb-73c2-48f3-996f-4b9e4ab71b20 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:02.612746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc10d6d-d00b-49ad-ae66-58c8f9bef0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:02.613408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10d6d-d00b-49ad-ae66-58c8f9bef0f9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.613683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10d6d-d00b-49ad-ae66-58c8f9bef0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.613949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10d6d-d00b-49ad-ae66-58c8f9bef0f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.615113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc10d6d-d00b-49ad-ae66-58c8f9bef0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:02.616546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc10d6d-d00b-49ad-ae66-58c8f9bef0f9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:02.618197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 158/313] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:02.618950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc10d6d-d00b-49ad-ae66-58c8f9bef0f9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:02.672459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:02.717127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114120bb-73c2-48f3-996f-4b9e4ab71b20 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:02.722848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:02.732402 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc10d6d-d00b-49ad-ae66-58c8f9bef0f9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:02.756053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecdc3a-7f37-403d-ae18-8e25f7c2c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:02.756699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdc3a-7f37-403d-ae18-8e25f7c2c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.756979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdc3a-7f37-403d-ae18-8e25f7c2c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.757389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecdc3a-7f37-403d-ae18-8e25f7c2c9a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.758129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecdc3a-7f37-403d-ae18-8e25f7c2c9a8 None admin] RBAC: Adding query filter params (role.id=7a14ec7cc43c4b5fa0516c5d46f059db, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf, user.id=8036b5e4fcce4a6a9d29b329bd4cd9e3) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:02.758430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecdc3a-7f37-403d-ae18-8e25f7c2c9a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:02.759995 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecdc3a-7f37-403d-ae18-8e25f7c2c9a8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:02.777329 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 156/314] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:02 2022] GET /identity/v3/role_assignments?user.id=8036b5e4fcce4a6a9d29b329bd4cd9e3&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=7a14ec7cc43c4b5fa0516c5d46f059db => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:02.777329 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecdc3a-7f37-403d-ae18-8e25f7c2c9a8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:02.780109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c5ca9-c6d2-4581-9735-37f26338fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:02.780814 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c5ca9-c6d2-4581-9735-37f26338fdb9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.781155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c5ca9-c6d2-4581-9735-37f26338fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.781463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c5ca9-c6d2-4581-9735-37f26338fdb9 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.782133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c5ca9-c6d2-4581-9735-37f26338fdb9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:02.782430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c5ca9-c6d2-4581-9735-37f26338fdb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:02.783863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c5ca9-c6d2-4581-9735-37f26338fdb9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:02.798743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 159/315] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:02.799951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c5ca9-c6d2-4581-9735-37f26338fdb9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:02.918894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c5ca9-c6d2-4581-9735-37f26338fdb9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:02.932602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecdc3a-7f37-403d-ae18-8e25f7c2c9a8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:02.959350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97435d5-b648-4190-969e-312fe6b1946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:02.960339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:02.960466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97435d5-b648-4190-969e-312fe6b1946b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.960543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97435d5-b648-4190-969e-312fe6b1946b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.960776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97435d5-b648-4190-969e-312fe6b1946b None admin] PATH_INFO: `/v3/users/3b2b18b5e2f94234b4bdd400ac3c7a2f` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.971890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d454b1b-d7a6-426a-8b9c-faeb560d164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:02.979146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454b1b-d7a6-426a-8b9c-faeb560d164a None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:02.979146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454b1b-d7a6-426a-8b9c-faeb560d164a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:02.979146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d454b1b-d7a6-426a-8b9c-faeb560d164a None admin] PATH_INFO: `/v3/groups` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:02.979146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d454b1b-d7a6-426a-8b9c-faeb560d164a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:02.979146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d454b1b-d7a6-426a-8b9c-faeb560d164a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:02.979488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97435d5-b648-4190-969e-312fe6b1946b None admin] RBAC: Authorizing `identity:get_user(user_id=3b2b18b5e2f94234b4bdd400ac3c7a2f)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:02.979488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97435d5-b648-4190-969e-312fe6b1946b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:02.982521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 160/316] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:41:02 2022] GET /identity/v3/users/3b2b18b5e2f94234b4bdd400ac3c7a2f => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:02.984591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97435d5-b648-4190-969e-312fe6b1946b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:03.003210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:03.038712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 157/317] 10.222.0.77 () {60 vars in 1134 bytes} [Wed Aug 10 22:41:02 2022] POST /identity/v3/groups => generated 229 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:41:03.101332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97435d5-b648-4190-969e-312fe6b1946b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:03.139698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9247628-1c30-4241-8efe-877bf285fbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:03.140559 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9247628-1c30-4241-8efe-877bf285fbb9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:03.140984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9247628-1c30-4241-8efe-877bf285fbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:03.141448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9247628-1c30-4241-8efe-877bf285fbb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:03.142338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9247628-1c30-4241-8efe-877bf285fbb9 None admin] RBAC: Adding query filter params (role.id=7a14ec7cc43c4b5fa0516c5d46f059db, user.id=3b2b18b5e2f94234b4bdd400ac3c7a2f, scope.system=all) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:03.142782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9247628-1c30-4241-8efe-877bf285fbb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:03.144364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9247628-1c30-4241-8efe-877bf285fbb9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:03.150976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 161/318] 10.222.0.77 () {56 vars in 1308 bytes} [Wed Aug 10 22:41:02 2022] GET /identity/v3/role_assignments?user.id=3b2b18b5e2f94234b4bdd400ac3c7a2f&scope.system=all&role.id=7a14ec7cc43c4b5fa0516c5d46f059db => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:04.347552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886cc01-de58-4891-9b33-f0bfbc33973a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:04.348078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886cc01-de58-4891-9b33-f0bfbc33973a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:04.348078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886cc01-de58-4891-9b33-f0bfbc33973a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:04.349474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 158/319] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:04.354622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9850f45-f008-43eb-9c9c-a9c72bc27c84 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:04.355008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9850f45-f008-43eb-9c9c-a9c72bc27c84 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:04.355162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9850f45-f008-43eb-9c9c-a9c72bc27c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:04.373538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e9850f45-f008-43eb-9c9c-a9c72bc27c84 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:04.374702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e9850f45-f008-43eb-9c9c-a9c72bc27c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:04.439244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 162/320] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:04.462352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886cc01-de58-4891-9b33-f0bfbc33973a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:04.570077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886cc01-de58-4891-9b33-f0bfbc33973a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:04.605721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e161-701f-4ec8-9a6e-c24a72c9a19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:04.606260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e161-701f-4ec8-9a6e-c24a72c9a19f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:04.606586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e161-701f-4ec8-9a6e-c24a72c9a19f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:04.606859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e161-701f-4ec8-9a6e-c24a72c9a19f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:04.618655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9e161-701f-4ec8-9a6e-c24a72c9a19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-b8e9e161-701f-4ec8-9a6e-c24a72c9a19f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:04.623815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:04.624665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:04.630337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 159/321] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:04.633022 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9850f45-f008-43eb-9c9c-a9c72bc27c84 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:04.641612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:04.735517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9850f45-f008-43eb-9c9c-a9c72bc27c84 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:04.769586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fa66b-1b21-47b6-b951-adb4ec79de50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:04.770202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fa66b-1b21-47b6-b951-adb4ec79de50 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:04.770474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fa66b-1b21-47b6-b951-adb4ec79de50 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:04.770737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fa66b-1b21-47b6-b951-adb4ec79de50 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:04.771441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fa66b-1b21-47b6-b951-adb4ec79de50 None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:04.771732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fa66b-1b21-47b6-b951-adb4ec79de50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:04.773095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fa66b-1b21-47b6-b951-adb4ec79de50 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:04.782016 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 163/322] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:04.788039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e161-701f-4ec8-9a6e-c24a72c9a19f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:04.835758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:04.892438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e161-701f-4ec8-9a6e-c24a72c9a19f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:04.926806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7687d-0904-40c6-9fc6-2ff9ed6cd4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:04.928049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7687d-0904-40c6-9fc6-2ff9ed6cd4eb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:04.928321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7687d-0904-40c6-9fc6-2ff9ed6cd4eb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:04.928591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7687d-0904-40c6-9fc6-2ff9ed6cd4eb None admin] PATH_INFO: `/v3/users/38b4c736ccd649fea497a5f8f31c8dca` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:04.929733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7687d-0904-40c6-9fc6-2ff9ed6cd4eb None admin] RBAC: Authorizing `identity:get_user(user_id=38b4c736ccd649fea497a5f8f31c8dca)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:04.931188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7687d-0904-40c6-9fc6-2ff9ed6cd4eb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:04.937510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 160/323] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:41:04 2022] GET /identity/v3/users/38b4c736ccd649fea497a5f8f31c8dca => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:04.939013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fa66b-1b21-47b6-b951-adb4ec79de50 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:05.007557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:05.043470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fa66b-1b21-47b6-b951-adb4ec79de50 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:05.077325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1ca0c-666b-416a-b012-08f94f3db08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:05.077930 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1ca0c-666b-416a-b012-08f94f3db08f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.078204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1ca0c-666b-416a-b012-08f94f3db08f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.078471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1ca0c-666b-416a-b012-08f94f3db08f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.079183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1ca0c-666b-416a-b012-08f94f3db08f None admin] RBAC: Adding query filter params (role.id=ec8d0b12e5324b00bca50fea232c8690, user.id=38b4c736ccd649fea497a5f8f31c8dca, scope.system=all) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:05.079488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1ca0c-666b-416a-b012-08f94f3db08f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:05.080899 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1ca0c-666b-416a-b012-08f94f3db08f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:05.092758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 164/324] 10.222.0.77 () {56 vars in 1308 bytes} [Wed Aug 10 22:41:04 2022] GET /identity/v3/role_assignments?user.id=38b4c736ccd649fea497a5f8f31c8dca&scope.system=all&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 510 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:05.108202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875ced6-fe1c-4444-9bad-54499b3c8189 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.108536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875ced6-fe1c-4444-9bad-54499b3c8189 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.108759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875ced6-fe1c-4444-9bad-54499b3c8189 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.110438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 161/325] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:05.116601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a5129-cb3e-4f63-b9cc-a09331472ab9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.116895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a5129-cb3e-4f63-b9cc-a09331472ab9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.117156 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a5129-cb3e-4f63-b9cc-a09331472ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.134938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3963-dd8b-4b7b-9531-94baef3b2f70 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.135227 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3963-dd8b-4b7b-9531-94baef3b2f70 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.135496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3963-dd8b-4b7b-9531-94baef3b2f70 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.136481 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-523a5129-cb3e-4f63-b9cc-a09331472ab9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:05.136822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 162/326] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:41:05.138013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-523a5129-cb3e-4f63-b9cc-a09331472ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:05.142316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14849509-2841-43ad-9d05-24fc086b317d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.142650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14849509-2841-43ad-9d05-24fc086b317d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.142866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14849509-2841-43ad-9d05-24fc086b317d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.162924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-14849509-2841-43ad-9d05-24fc086b317d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:05.164175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-14849509-2841-43ad-9d05-24fc086b317d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:05.226787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 165/327] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:05.240678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 163/328] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:41:05.249237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a5129-cb3e-4f63-b9cc-a09331472ab9 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:05.262623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14849509-2841-43ad-9d05-24fc086b317d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:05.310989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:05.318002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:05.363847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a5129-cb3e-4f63-b9cc-a09331472ab9 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:05.370972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14849509-2841-43ad-9d05-24fc086b317d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:05.399184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e0846-062d-4ee0-ba2e-ba47d2b61314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:05.399741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e0846-062d-4ee0-ba2e-ba47d2b61314 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.400014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e0846-062d-4ee0-ba2e-ba47d2b61314 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.400537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e0846-062d-4ee0-ba2e-ba47d2b61314 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.401426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e0846-062d-4ee0-ba2e-ba47d2b61314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:05.402850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e0846-062d-4ee0-ba2e-ba47d2b61314 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:05.404412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 166/329] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:05.410107 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609c640-7f2b-4f03-bed4-79c821047d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:05.410607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e0846-062d-4ee0-ba2e-ba47d2b61314 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:05.412789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609c640-7f2b-4f03-bed4-79c821047d24 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.412789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609c640-7f2b-4f03-bed4-79c821047d24 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.412789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609c640-7f2b-4f03-bed4-79c821047d24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.422372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609c640-7f2b-4f03-bed4-79c821047d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-d609c640-7f2b-4f03-bed4-79c821047d24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:05.427063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:05.437159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 164/330] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:05.437987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609c640-7f2b-4f03-bed4-79c821047d24 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:05.509069 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e0846-062d-4ee0-ba2e-ba47d2b61314 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:05.533199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:05.535663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609c640-7f2b-4f03-bed4-79c821047d24 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:05.539689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:05.543845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbef3f-25d0-40c9-a3e4-6f3aea0a0854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:05.544482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbef3f-25d0-40c9-a3e4-6f3aea0a0854 None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.544735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbef3f-25d0-40c9-a3e4-6f3aea0a0854 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.544998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbef3f-25d0-40c9-a3e4-6f3aea0a0854 None admin] PATH_INFO: `/v3/groups` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.545654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbef3f-25d0-40c9-a3e4-6f3aea0a0854 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:05.547131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbef3f-25d0-40c9-a3e4-6f3aea0a0854 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:05.575235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf419c6d-6f86-4516-977e-6a30c72f53c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:05.575857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf419c6d-6f86-4516-977e-6a30c72f53c6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.576135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf419c6d-6f86-4516-977e-6a30c72f53c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.576410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf419c6d-6f86-4516-977e-6a30c72f53c6 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.577187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf419c6d-6f86-4516-977e-6a30c72f53c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:05.577524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf419c6d-6f86-4516-977e-6a30c72f53c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:05.578899 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf419c6d-6f86-4516-977e-6a30c72f53c6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:05.588012 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 165/331] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:05.593703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf419c6d-6f86-4516-977e-6a30c72f53c6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:05.639777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 167/332] 10.222.0.77 () {60 vars in 1134 bytes} [Wed Aug 10 22:41:05 2022] POST /identity/v3/groups => generated 226 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:41:05.706935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf419c6d-6f86-4516-977e-6a30c72f53c6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:05.743942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8489b-18ca-4321-b13e-98dc95bf8089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:05.744582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8489b-18ca-4321-b13e-98dc95bf8089 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.744860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8489b-18ca-4321-b13e-98dc95bf8089 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.745130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8489b-18ca-4321-b13e-98dc95bf8089 None admin] PATH_INFO: `/v3/users/3b2b18b5e2f94234b4bdd400ac3c7a2f` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.746326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8489b-18ca-4321-b13e-98dc95bf8089 None admin] RBAC: Authorizing `identity:get_user(user_id=3b2b18b5e2f94234b4bdd400ac3c7a2f)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:05.747799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8489b-18ca-4321-b13e-98dc95bf8089 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:05.749459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 166/333] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:41:05 2022] GET /identity/v3/users/3b2b18b5e2f94234b4bdd400ac3c7a2f => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:05.755896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbef3f-25d0-40c9-a3e4-6f3aea0a0854 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:05.863473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbef3f-25d0-40c9-a3e4-6f3aea0a0854 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:05.900314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e9759-babb-4ab2-9147-af897d8ea1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:05.901077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e9759-babb-4ab2-9147-af897d8ea1cb None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:05.901472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e9759-babb-4ab2-9147-af897d8ea1cb None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:05.901752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e9759-babb-4ab2-9147-af897d8ea1cb None admin] PATH_INFO: `/v3/system/users/3b2b18b5e2f94234b4bdd400ac3c7a2f/roles/7a14ec7cc43c4b5fa0516c5d46f059db` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:05.903199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e9759-babb-4ab2-9147-af897d8ea1cb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3b2b18b5e2f94234b4bdd400ac3c7a2f, role_id=7a14ec7cc43c4b5fa0516c5d46f059db)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:05.904616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e9759-babb-4ab2-9147-af897d8ea1cb None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:05.948768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 168/334] 10.222.0.77 () {58 vars in 1334 bytes} [Wed Aug 10 22:41:05 2022] PUT /identity/v3/system/users/3b2b18b5e2f94234b4bdd400ac3c7a2f/roles/7a14ec7cc43c4b5fa0516c5d46f059db => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:08.004292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d84d5-f376-457b-9c72-146905bcb8b9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:08.005325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d84d5-f376-457b-9c72-146905bcb8b9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:08.005805 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d84d5-f376-457b-9c72-146905bcb8b9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:08.007626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 167/335] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:08.013241 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b93f7-31b6-4594-a087-95073355493a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:08.014152 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b93f7-31b6-4594-a087-95073355493a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:08.014613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b93f7-31b6-4594-a087-95073355493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:08.036202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-574b93f7-31b6-4594-a087-95073355493a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:08.038273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-574b93f7-31b6-4594-a087-95073355493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:08.091860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:08.110914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844949c0-0edb-408d-a672-f80b23168e2d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:08.111229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844949c0-0edb-408d-a672-f80b23168e2d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:08.111446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844949c0-0edb-408d-a672-f80b23168e2d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:08.113041 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 168/336] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:41:08.118813 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62610cd1-7d14-43c3-a4d6-4c98caff2665 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:08.119095 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62610cd1-7d14-43c3-a4d6-4c98caff2665 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:08.119371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62610cd1-7d14-43c3-a4d6-4c98caff2665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:08.121896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 169/337] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:08.138890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-62610cd1-7d14-43c3-a4d6-4c98caff2665 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:08.140775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-62610cd1-7d14-43c3-a4d6-4c98caff2665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:08.160950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b93f7-31b6-4594-a087-95073355493a None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:08.169026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:08.227912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 169/338] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:08.305075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b93f7-31b6-4594-a087-95073355493a None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:08.346903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e5600-cf25-4888-8138-636f3fd2f65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:08.356927 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5600-cf25-4888-8138-636f3fd2f65d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:08.356927 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5600-cf25-4888-8138-636f3fd2f65d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:08.356927 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5600-cf25-4888-8138-636f3fd2f65d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:08.357162 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62610cd1-7d14-43c3-a4d6-4c98caff2665 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:08.385931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e5600-cf25-4888-8138-636f3fd2f65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-424e5600-cf25-4888-8138-636f3fd2f65d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:08.390756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:08.392080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:08.392869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 170/339] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:08.399983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e5600-cf25-4888-8138-636f3fd2f65d None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:08.488226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:08.541559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62610cd1-7d14-43c3-a4d6-4c98caff2665 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:08.646933 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0ce13-f8a3-4294-84c3-fe82fd546e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:08.647490 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0ce13-f8a3-4294-84c3-fe82fd546e3d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:08.647763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0ce13-f8a3-4294-84c3-fe82fd546e3d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:08.648027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0ce13-f8a3-4294-84c3-fe82fd546e3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:08.650436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e5600-cf25-4888-8138-636f3fd2f65d None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:08.671257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0ce13-f8a3-4294-84c3-fe82fd546e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-1ce0ce13-f8a3-4294-84c3-fe82fd546e3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:08.676221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:08.677154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:08.677973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 170/340] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:08.683562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0ce13-f8a3-4294-84c3-fe82fd546e3d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:08.715260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:08.717751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c43ea-06da-4d0f-9eec-61f62e35b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:08.718383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c43ea-06da-4d0f-9eec-61f62e35b3ae None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:08.718661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c43ea-06da-4d0f-9eec-61f62e35b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:08.718931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c43ea-06da-4d0f-9eec-61f62e35b3ae None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:08.719621 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c43ea-06da-4d0f-9eec-61f62e35b3ae None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:08.719918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c43ea-06da-4d0f-9eec-61f62e35b3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:08.721343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c43ea-06da-4d0f-9eec-61f62e35b3ae None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:08.747060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 171/341] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:08.758558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c43ea-06da-4d0f-9eec-61f62e35b3ae None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:08.806221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0ce13-f8a3-4294-84c3-fe82fd546e3d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:08.848055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d69554-aedd-4727-b3cc-00cb49b9fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:08.849218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d69554-aedd-4727-b3cc-00cb49b9fea0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:08.849538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d69554-aedd-4727-b3cc-00cb49b9fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:08.849814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d69554-aedd-4727-b3cc-00cb49b9fea0 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:08.850503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d69554-aedd-4727-b3cc-00cb49b9fea0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:08.852803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d69554-aedd-4727-b3cc-00cb49b9fea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:08.852803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d69554-aedd-4727-b3cc-00cb49b9fea0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:08.865709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 171/342] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:08.881958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d69554-aedd-4727-b3cc-00cb49b9fea0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:08.946788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:08.950555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c43ea-06da-4d0f-9eec-61f62e35b3ae None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:08.991312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214055-95ec-48c4-96e6-fa6a7457a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:08.992275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214055-95ec-48c4-96e6-fa6a7457a0cf None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:08.992775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214055-95ec-48c4-96e6-fa6a7457a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:08.993260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce214055-95ec-48c4-96e6-fa6a7457a0cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.013270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:09.036155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d69554-aedd-4727-b3cc-00cb49b9fea0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:09.081603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce214055-95ec-48c4-96e6-fa6a7457a0cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:09.083783 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce214055-95ec-48c4-96e6-fa6a7457a0cf None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:09.085563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd710d-da3d-46ca-af8b-8115eaf73967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:09.086333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd710d-da3d-46ca-af8b-8115eaf73967 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.086630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd710d-da3d-46ca-af8b-8115eaf73967 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.086926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd710d-da3d-46ca-af8b-8115eaf73967 None admin] PATH_INFO: `/v3/users/3b2b18b5e2f94234b4bdd400ac3c7a2f` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.088486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd710d-da3d-46ca-af8b-8115eaf73967 None admin] RBAC: Authorizing `identity:get_user(user_id=3b2b18b5e2f94234b4bdd400ac3c7a2f)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:09.093860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd710d-da3d-46ca-af8b-8115eaf73967 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:09.102627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 172/343] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:41:08 2022] GET /identity/v3/users/3b2b18b5e2f94234b4bdd400ac3c7a2f => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:09.103087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810761d0-4806-4e66-aab5-9573a6b890f2 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.103382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810761d0-4806-4e66-aab5-9573a6b890f2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.103650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810761d0-4806-4e66-aab5-9573a6b890f2 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.105151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 173/344] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:09.106694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8316d6-126e-4e74-94a1-dd8e4e8fc970 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.106975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8316d6-126e-4e74-94a1-dd8e4e8fc970 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.107246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8316d6-126e-4e74-94a1-dd8e4e8fc970 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.109136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 174/345] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:09.110711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b5cb8-3469-480a-b627-7d00c59716cf None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.110998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b5cb8-3469-480a-b627-7d00c59716cf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.111265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b5cb8-3469-480a-b627-7d00c59716cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.144864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-895b5cb8-3469-480a-b627-7d00c59716cf None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:09.146067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-895b5cb8-3469-480a-b627-7d00c59716cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:09.224688 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:09.232258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 172/346] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:09.234254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214055-95ec-48c4-96e6-fa6a7457a0cf None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:09.258974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 175/347] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:09.258974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75574fa1-4c16-4880-9de6-8ca3ecb26a19 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.258974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75574fa1-4c16-4880-9de6-8ca3ecb26a19 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.258974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75574fa1-4c16-4880-9de6-8ca3ecb26a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.289984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-75574fa1-4c16-4880-9de6-8ca3ecb26a19 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:09.292687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-75574fa1-4c16-4880-9de6-8ca3ecb26a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:09.373263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 176/348] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:09.378153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75574fa1-4c16-4880-9de6-8ca3ecb26a19 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:09.379014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce214055-95ec-48c4-96e6-fa6a7457a0cf None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:09.402605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:09.422658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5a9b-2be2-4c92-a99d-4f726b5410c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:09.423916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5a9b-2be2-4c92-a99d-4f726b5410c1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.424424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5a9b-2be2-4c92-a99d-4f726b5410c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.424907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5a9b-2be2-4c92-a99d-4f726b5410c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.425937 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b5a9b-2be2-4c92-a99d-4f726b5410c1 None admin] RBAC: Adding query filter params (role.id=7a14ec7cc43c4b5fa0516c5d46f059db, user.id=3b2b18b5e2f94234b4bdd400ac3c7a2f, scope.system=all) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:09.426447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b5a9b-2be2-4c92-a99d-4f726b5410c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:09.429888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b5a9b-2be2-4c92-a99d-4f726b5410c1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:09.445271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 173/349] 10.222.0.77 () {56 vars in 1308 bytes} [Wed Aug 10 22:41:09 2022] GET /identity/v3/role_assignments?user.id=3b2b18b5e2f94234b4bdd400ac3c7a2f&scope.system=all&role.id=7a14ec7cc43c4b5fa0516c5d46f059db => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:09.447239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5a9b-2be2-4c92-a99d-4f726b5410c1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:09.514882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:09.575801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5a9b-2be2-4c92-a99d-4f726b5410c1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:09.575997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75574fa1-4c16-4880-9de6-8ca3ecb26a19 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:09.628174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1718a6-ba49-4ee4-986f-eb9a0b9b0176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:09.629969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1718a6-ba49-4ee4-986f-eb9a0b9b0176 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.630740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1718a6-ba49-4ee4-986f-eb9a0b9b0176 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.631700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1718a6-ba49-4ee4-986f-eb9a0b9b0176 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.645690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1718a6-ba49-4ee4-986f-eb9a0b9b0176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5c1718a6-ba49-4ee4-986f-eb9a0b9b0176 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:09.653337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:09.654292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:09.655103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:09.657806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 174/350] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:09.659120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1718a6-ba49-4ee4-986f-eb9a0b9b0176 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:09.676559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421638d4-a567-4c80-9724-eadcf2de3ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:09.677262 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421638d4-a567-4c80-9724-eadcf2de3ac5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.677562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421638d4-a567-4c80-9724-eadcf2de3ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.678330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421638d4-a567-4c80-9724-eadcf2de3ac5 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.679152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421638d4-a567-4c80-9724-eadcf2de3ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:09.681110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421638d4-a567-4c80-9724-eadcf2de3ac5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:09.683550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 177/351] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:09 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:09.684410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421638d4-a567-4c80-9724-eadcf2de3ac5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:09.838757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1718a6-ba49-4ee4-986f-eb9a0b9b0176 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:09.852477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:09.862025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:09.874055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421638d4-a567-4c80-9724-eadcf2de3ac5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:09.886903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4994433-3d45-4492-9d3d-7b8391779b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:09.887855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4994433-3d45-4492-9d3d-7b8391779b5b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.888306 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4994433-3d45-4492-9d3d-7b8391779b5b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.888773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4994433-3d45-4492-9d3d-7b8391779b5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.904361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4994433-3d45-4492-9d3d-7b8391779b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-a4994433-3d45-4492-9d3d-7b8391779b5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:09.909879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:09.910801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:09.912201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:09.915616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 175/352] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:41:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:09.916834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4994433-3d45-4492-9d3d-7b8391779b5b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:09.930947 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4b62d-69fa-40be-a284-700252af04ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:09.932240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b62d-69fa-40be-a284-700252af04ce None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.932940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b62d-69fa-40be-a284-700252af04ce None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.933484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b62d-69fa-40be-a284-700252af04ce None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.934485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4b62d-69fa-40be-a284-700252af04ce None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:09.934973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4b62d-69fa-40be-a284-700252af04ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:09.936891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4b62d-69fa-40be-a284-700252af04ce None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:09.952440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 178/353] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:09.954664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81cd8-bc0a-4239-b2d1-db4c5adeb499 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:09.955211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81cd8-bc0a-4239-b2d1-db4c5adeb499 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:09.955919 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c81cd8-bc0a-4239-b2d1-db4c5adeb499 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:09.958093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 179/354] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:09.959643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c81cd8-bc0a-4239-b2d1-db4c5adeb499 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:10.062117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4994433-3d45-4492-9d3d-7b8391779b5b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:10.108080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c81cd8-bc0a-4239-b2d1-db4c5adeb499 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:10.112258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70f74-6493-4c63-aacf-80c03d727bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:10.113774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70f74-6493-4c63-aacf-80c03d727bbd None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:10.114054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70f74-6493-4c63-aacf-80c03d727bbd None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:10.114327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70f74-6493-4c63-aacf-80c03d727bbd None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:10.128653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70f74-6493-4c63-aacf-80c03d727bbd None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:10.130162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70f74-6493-4c63-aacf-80c03d727bbd None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:10.132407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 176/355] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:09 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:10.133183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70f74-6493-4c63-aacf-80c03d727bbd None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:10.164494 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79790d-ae60-441a-a395-d1e64bc43ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:10.165103 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79790d-ae60-441a-a395-d1e64bc43ff4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:10.165696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79790d-ae60-441a-a395-d1e64bc43ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:10.165977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79790d-ae60-441a-a395-d1e64bc43ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:10.166794 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79790d-ae60-441a-a395-d1e64bc43ff4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:10.167121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79790d-ae60-441a-a395-d1e64bc43ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:10.169609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79790d-ae60-441a-a395-d1e64bc43ff4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:10.185849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 180/356] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:10.187118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aba3a-e820-496e-b131-049d012bd173 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:10.187400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aba3a-e820-496e-b131-049d012bd173 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:10.187672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aba3a-e820-496e-b131-049d012bd173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:10.191597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:10.199295 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:10.216234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-068aba3a-e820-496e-b131-049d012bd173 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:10.217446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-068aba3a-e820-496e-b131-049d012bd173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:10.266565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70f74-6493-4c63-aacf-80c03d727bbd None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:10.309200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 181/357] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:10.309971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068aba3a-e820-496e-b131-049d012bd173 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:10.312174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c4a8e-3228-433d-9277-8482febee47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:10.312787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c4a8e-3228-433d-9277-8482febee47c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:10.313064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c4a8e-3228-433d-9277-8482febee47c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:10.313434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c4a8e-3228-433d-9277-8482febee47c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:10.404463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c4a8e-3228-433d-9277-8482febee47c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:10.406394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c4a8e-3228-433d-9277-8482febee47c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:10.436719 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068aba3a-e820-496e-b131-049d012bd173 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:10.455588 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:10.475685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791dfbc-49cd-4979-9a17-42ccdcb78b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:10.476233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791dfbc-49cd-4979-9a17-42ccdcb78b73 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:10.476505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791dfbc-49cd-4979-9a17-42ccdcb78b73 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:10.476784 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791dfbc-49cd-4979-9a17-42ccdcb78b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:10.477672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791dfbc-49cd-4979-9a17-42ccdcb78b73 None admin] RBAC: Adding query filter params (group.id=9f2b0abf646748adb67ea52b7c2bc199, role.id=ec8d0b12e5324b00bca50fea232c8690, scope.project.id=c3806275c2874038ad80b383d2238272) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:10.478414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791dfbc-49cd-4979-9a17-42ccdcb78b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:10.479443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791dfbc-49cd-4979-9a17-42ccdcb78b73 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:10.481889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:10.486663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 182/358] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Aug 10 22:41:10 2022] GET /identity/v3/role_assignments?group.id=9f2b0abf646748adb67ea52b7c2bc199&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:10.487281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791dfbc-49cd-4979-9a17-42ccdcb78b73 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:10.543431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 177/359] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:10.545190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d192f-39fd-4e07-93d0-d78ec1b687e1 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:10.545815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d192f-39fd-4e07-93d0-d78ec1b687e1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:10.546295 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d192f-39fd-4e07-93d0-d78ec1b687e1 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:10.548230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 178/360] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:10.553366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d192f-39fd-4e07-93d0-d78ec1b687e1 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:10.636821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791dfbc-49cd-4979-9a17-42ccdcb78b73 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:10.683053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089a4e7-90db-41b3-b4b1-eff711790818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:10.683584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089a4e7-90db-41b3-b4b1-eff711790818 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:10.683858 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089a4e7-90db-41b3-b4b1-eff711790818 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:10.684149 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089a4e7-90db-41b3-b4b1-eff711790818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:10.691585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d192f-39fd-4e07-93d0-d78ec1b687e1 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:10.737543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107747a-b78d-4b8e-902f-03ea49300796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:10.738532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107747a-b78d-4b8e-902f-03ea49300796 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:10.738811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107747a-b78d-4b8e-902f-03ea49300796 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:10.739079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107747a-b78d-4b8e-902f-03ea49300796 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:10.751982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107747a-b78d-4b8e-902f-03ea49300796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d107747a-b78d-4b8e-902f-03ea49300796 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:10.757960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:10.758836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 179/361] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:41:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:10.760062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107747a-b78d-4b8e-902f-03ea49300796 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:10.765077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:10.771641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:10.777923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089a4e7-90db-41b3-b4b1-eff711790818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:10.779650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089a4e7-90db-41b3-b4b1-eff711790818 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:10.910352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107747a-b78d-4b8e-902f-03ea49300796 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:10.921211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 183/362] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:10.923583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401963-3465-46d8-a0a9-f1f5ec721479 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:10.924045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401963-3465-46d8-a0a9-f1f5ec721479 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:10.924622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401963-3465-46d8-a0a9-f1f5ec721479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:10.946663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e6401963-3465-46d8-a0a9-f1f5ec721479 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:10.948177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e6401963-3465-46d8-a0a9-f1f5ec721479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:10.952079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e91bf-7fe7-4250-81d0-8ccd47f3f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:10.952665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e91bf-7fe7-4250-81d0-8ccd47f3f184 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:10.952937 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e91bf-7fe7-4250-81d0-8ccd47f3f184 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:10.953200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e91bf-7fe7-4250-81d0-8ccd47f3f184 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:10.954410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e91bf-7fe7-4250-81d0-8ccd47f3f184 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:10.955826 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e91bf-7fe7-4250-81d0-8ccd47f3f184 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:10.962678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 180/363] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:10 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:10.963596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e91bf-7fe7-4250-81d0-8ccd47f3f184 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:11.028508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 184/364] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:11.029486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6401963-3465-46d8-a0a9-f1f5ec721479 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:11.055245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:11.059439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:11.084305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e91bf-7fe7-4250-81d0-8ccd47f3f184 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:11.128316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53832177-7ead-419d-8939-887db4ae4c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:11.129129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53832177-7ead-419d-8939-887db4ae4c77 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:11.129225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53832177-7ead-419d-8939-887db4ae4c77 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:11.129531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53832177-7ead-419d-8939-887db4ae4c77 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:11.130233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53832177-7ead-419d-8939-887db4ae4c77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:11.131086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53832177-7ead-419d-8939-887db4ae4c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:11.132519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53832177-7ead-419d-8939-887db4ae4c77 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:11.147294 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 181/365] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:11.151002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53832177-7ead-419d-8939-887db4ae4c77 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:11.169687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6401963-3465-46d8-a0a9-f1f5ec721479 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:11.213977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c8f0-a53b-4b02-90a1-dde6f6b0bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:11.214945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c8f0-a53b-4b02-90a1-dde6f6b0bb36 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:11.215413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c8f0-a53b-4b02-90a1-dde6f6b0bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:11.215890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c8f0-a53b-4b02-90a1-dde6f6b0bb36 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:11.217207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94c8f0-a53b-4b02-90a1-dde6f6b0bb36 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:11.218826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94c8f0-a53b-4b02-90a1-dde6f6b0bb36 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:11.220616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 185/366] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:11 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:11.221540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c8f0-a53b-4b02-90a1-dde6f6b0bb36 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:11.289858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53832177-7ead-419d-8939-887db4ae4c77 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:11.333352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:11.338947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283303d9-3e34-4ec7-b66a-64102db1da09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:11.339442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283303d9-3e34-4ec7-b66a-64102db1da09 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:11.339754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283303d9-3e34-4ec7-b66a-64102db1da09 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:11.339979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283303d9-3e34-4ec7-b66a-64102db1da09 None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:11.340409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:11.341191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283303d9-3e34-4ec7-b66a-64102db1da09 None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:11.343038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283303d9-3e34-4ec7-b66a-64102db1da09 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:11.346236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 182/367] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:11 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:11.346236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283303d9-3e34-4ec7-b66a-64102db1da09 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:11.346393 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c8f0-a53b-4b02-90a1-dde6f6b0bb36 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:11.398288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810ca6d-7c20-419e-bb83-3d825588a766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:11.399276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810ca6d-7c20-419e-bb83-3d825588a766 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:11.399763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810ca6d-7c20-419e-bb83-3d825588a766 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:11.400217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810ca6d-7c20-419e-bb83-3d825588a766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:11.413954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810ca6d-7c20-419e-bb83-3d825588a766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5810ca6d-7c20-419e-bb83-3d825588a766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:11.419420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:11.420468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:11.421409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:11.423316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 186/368] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:11.424208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810ca6d-7c20-419e-bb83-3d825588a766 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:11.478242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283303d9-3e34-4ec7-b66a-64102db1da09 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:11.520277 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14bb23-aec3-45b9-8603-50a0304b52b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:11.521172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14bb23-aec3-45b9-8603-50a0304b52b9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:11.521570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14bb23-aec3-45b9-8603-50a0304b52b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:11.521879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14bb23-aec3-45b9-8603-50a0304b52b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:11.554106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810ca6d-7c20-419e-bb83-3d825588a766 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:11.597639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09974947-0d2f-4b05-b629-495b81c156eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:11.598409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09974947-0d2f-4b05-b629-495b81c156eb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:11.598716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09974947-0d2f-4b05-b629-495b81c156eb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:11.599598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09974947-0d2f-4b05-b629-495b81c156eb None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:11.600816 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09974947-0d2f-4b05-b629-495b81c156eb None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:11.602440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09974947-0d2f-4b05-b629-495b81c156eb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:11.604031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 187/369] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:11 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:11.604794 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09974947-0d2f-4b05-b629-495b81c156eb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:11.625537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:11.627191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14bb23-aec3-45b9-8603-50a0304b52b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:11.627739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14bb23-aec3-45b9-8603-50a0304b52b9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:11.653226 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:11.738945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09974947-0d2f-4b05-b629-495b81c156eb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:11.756556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 183/370] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:11.757992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14bb23-aec3-45b9-8603-50a0304b52b9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:11.783536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedede5-6229-4363-8c48-2618bb6d5d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:11.784293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedede5-6229-4363-8c48-2618bb6d5d0f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:11.784639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedede5-6229-4363-8c48-2618bb6d5d0f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:11.784981 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedede5-6229-4363-8c48-2618bb6d5d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:11.785824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedede5-6229-4363-8c48-2618bb6d5d0f None admin] RBAC: Adding query filter params (group.id=9f2b0abf646748adb67ea52b7c2bc199, role.id=ec8d0b12e5324b00bca50fea232c8690, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:11.786172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedede5-6229-4363-8c48-2618bb6d5d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:11.789400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedede5-6229-4363-8c48-2618bb6d5d0f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:11.795532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 188/371] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Aug 10 22:41:11 2022] GET /identity/v3/role_assignments?group.id=9f2b0abf646748adb67ea52b7c2bc199&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:11.796157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedede5-6229-4363-8c48-2618bb6d5d0f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:11.910205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14bb23-aec3-45b9-8603-50a0304b52b9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:11.916439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedede5-6229-4363-8c48-2618bb6d5d0f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:11.926814 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:11.959448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:11.968004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d570e-4899-416c-b0c3-fd66695e8bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:11.968638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d570e-4899-416c-b0c3-fd66695e8bed None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:11.968913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d570e-4899-416c-b0c3-fd66695e8bed None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:11.969182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d570e-4899-416c-b0c3-fd66695e8bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:11.970490 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d570e-4899-416c-b0c3-fd66695e8bed None admin] RBAC: Adding query filter params (group.id=9f2b0abf646748adb67ea52b7c2bc199, role.id=6654493feb544c46aeca606d309a1af2, scope.project.id=c3806275c2874038ad80b383d2238272) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:11.970797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d570e-4899-416c-b0c3-fd66695e8bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:11.973562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d570e-4899-416c-b0c3-fd66695e8bed None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:11.974929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da357963-f0a7-4ade-b484-668975cf2b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:11.975836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357963-f0a7-4ade-b484-668975cf2b0e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:11.976339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357963-f0a7-4ade-b484-668975cf2b0e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:11.976810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357963-f0a7-4ade-b484-668975cf2b0e None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:11.978049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da357963-f0a7-4ade-b484-668975cf2b0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:11.978561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da357963-f0a7-4ade-b484-668975cf2b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:11.980130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da357963-f0a7-4ade-b484-668975cf2b0e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:11.982356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 189/372] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Aug 10 22:41:11 2022] GET /identity/v3/role_assignments?group.id=9f2b0abf646748adb67ea52b7c2bc199&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=6654493feb544c46aeca606d309a1af2 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:11.984001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d570e-4899-416c-b0c3-fd66695e8bed None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:11.993355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 184/373] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:11.997638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da357963-f0a7-4ade-b484-668975cf2b0e None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:12.155528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da357963-f0a7-4ade-b484-668975cf2b0e None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:12.164852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d570e-4899-416c-b0c3-fd66695e8bed None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:12.228420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173b117-431f-41f8-8c92-24292bf201c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:12.229031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173b117-431f-41f8-8c92-24292bf201c3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:12.229326 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173b117-431f-41f8-8c92-24292bf201c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:12.229952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173b117-431f-41f8-8c92-24292bf201c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:12.232699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9ced4-5ead-4f74-80e9-0b1c32019298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:12.235189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9ced4-5ead-4f74-80e9-0b1c32019298 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:12.235690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9ced4-5ead-4f74-80e9-0b1c32019298 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:12.236172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9ced4-5ead-4f74-80e9-0b1c32019298 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:12.237634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9ced4-5ead-4f74-80e9-0b1c32019298 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:12.239296 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9ced4-5ead-4f74-80e9-0b1c32019298 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:12.241700 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 190/374] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:11 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:12.250503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9ced4-5ead-4f74-80e9-0b1c32019298 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:12.288903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:12.290007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:12.379944 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173b117-431f-41f8-8c92-24292bf201c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:12.381984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173b117-431f-41f8-8c92-24292bf201c3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:12.411059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9ced4-5ead-4f74-80e9-0b1c32019298 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:12.479475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2e26-2062-4f99-9c12-5c0e023346f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:12.480106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2e26-2062-4f99-9c12-5c0e023346f6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:12.480379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2e26-2062-4f99-9c12-5c0e023346f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:12.480643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2e26-2062-4f99-9c12-5c0e023346f6 None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:12.484396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2e26-2062-4f99-9c12-5c0e023346f6 None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:12.488535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2e26-2062-4f99-9c12-5c0e023346f6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:12.490225 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 191/375] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:12 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:12.496187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2e26-2062-4f99-9c12-5c0e023346f6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:12.589131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 185/376] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 22:41:12.594920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173b117-431f-41f8-8c92-24292bf201c3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:12.647574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:12.662662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2e26-2062-4f99-9c12-5c0e023346f6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:12.711035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b50ed3-343f-4c13-b199-5676bc462c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:12.714276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50ed3-343f-4c13-b199-5676bc462c1f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:12.714276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50ed3-343f-4c13-b199-5676bc462c1f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:12.714276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50ed3-343f-4c13-b199-5676bc462c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:12.714276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b50ed3-343f-4c13-b199-5676bc462c1f None admin] RBAC: Adding query filter params (group.id=9f2b0abf646748adb67ea52b7c2bc199, role.id=6654493feb544c46aeca606d309a1af2, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:12.714276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b50ed3-343f-4c13-b199-5676bc462c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:12.714641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b50ed3-343f-4c13-b199-5676bc462c1f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:12.718099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:12.729004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 192/377] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Aug 10 22:41:12 2022] GET /identity/v3/role_assignments?group.id=9f2b0abf646748adb67ea52b7c2bc199&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=6654493feb544c46aeca606d309a1af2 => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:12.733861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d8e38-fec5-44c5-9bd4-21af7ad3c4b7 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:12.733861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d8e38-fec5-44c5-9bd4-21af7ad3c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:12.733861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d8e38-fec5-44c5-9bd4-21af7ad3c4b7 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:12.736596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 193/378] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:12.743215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e778-2bc7-43a6-8e74-d3625354802b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:12.743741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e778-2bc7-43a6-8e74-d3625354802b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:12.744159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e778-2bc7-43a6-8e74-d3625354802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:12.772833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fb72e778-2bc7-43a6-8e74-d3625354802b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:12.774571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fb72e778-2bc7-43a6-8e74-d3625354802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:12.813118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173b117-431f-41f8-8c92-24292bf201c3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:12.891544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a721f8-fe31-48cd-bd0b-22d3d8b2d129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:12.892489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a721f8-fe31-48cd-bd0b-22d3d8b2d129 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:12.893471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a721f8-fe31-48cd-bd0b-22d3d8b2d129 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:12.894683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a721f8-fe31-48cd-bd0b-22d3d8b2d129 None admin] PATH_INFO: `/v3/projects/98ff4b51ad344f35909bb4fdee93bcd4` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:12.895957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 194/379] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:41:12.896774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a721f8-fe31-48cd-bd0b-22d3d8b2d129 None admin] RBAC: Authorizing `identity:get_project(project_id=98ff4b51ad344f35909bb4fdee93bcd4)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:12.898519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a721f8-fe31-48cd-bd0b-22d3d8b2d129 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:12.900699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 186/380] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:12 2022] GET /identity/v3/projects/98ff4b51ad344f35909bb4fdee93bcd4 => generated 344 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:12.906076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72e778-2bc7-43a6-8e74-d3625354802b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:12.954840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a721f8-fe31-48cd-bd0b-22d3d8b2d129 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:13.033916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:13.064567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72e778-2bc7-43a6-8e74-d3625354802b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:13.115316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a721f8-fe31-48cd-bd0b-22d3d8b2d129 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:13.145205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2823bad-3bf8-47fa-942c-fbeed8ab2946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:13.145888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2823bad-3bf8-47fa-942c-fbeed8ab2946 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:13.146161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2823bad-3bf8-47fa-942c-fbeed8ab2946 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:13.146429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2823bad-3bf8-47fa-942c-fbeed8ab2946 None admin] PATH_INFO: `/v3/groups/dce7a1dd2eb0438fac4c478b60c2a991` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:13.149625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:13.156271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8f83-4595-4a51-8c6a-97a36c547e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:13.156938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8f83-4595-4a51-8c6a-97a36c547e20 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:13.157436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8f83-4595-4a51-8c6a-97a36c547e20 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:13.162455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8f83-4595-4a51-8c6a-97a36c547e20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:13.162574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2823bad-3bf8-47fa-942c-fbeed8ab2946 None admin] RBAC: Authorizing `identity:get_group(group_id=dce7a1dd2eb0438fac4c478b60c2a991)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:13.163820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2823bad-3bf8-47fa-942c-fbeed8ab2946 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:13.165505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 195/381] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:12 2022] GET /identity/v3/groups/dce7a1dd2eb0438fac4c478b60c2a991 => generated 229 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:13.172312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2823bad-3bf8-47fa-942c-fbeed8ab2946 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:13.184520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef8f83-4595-4a51-8c6a-97a36c547e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5cef8f83-4595-4a51-8c6a-97a36c547e20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:13.192490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:13.193537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:13.194386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:13.195491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 187/382] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:13.200822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8f83-4595-4a51-8c6a-97a36c547e20 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:13.362064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8f83-4595-4a51-8c6a-97a36c547e20 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:13.373189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2823bad-3bf8-47fa-942c-fbeed8ab2946 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:13.424501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfdaec-77ff-4080-a019-f03ebede9a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:13.425103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfdaec-77ff-4080-a019-f03ebede9a58 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:13.425397 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfdaec-77ff-4080-a019-f03ebede9a58 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:13.425665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfdaec-77ff-4080-a019-f03ebede9a58 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:13.426314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfdaec-77ff-4080-a019-f03ebede9a58 None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:13.426606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfdaec-77ff-4080-a019-f03ebede9a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:13.428478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cfdaec-77ff-4080-a019-f03ebede9a58 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:13.438063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0791-d911-47d6-8f86-6e07fa0d10a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:13.438561 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0791-d911-47d6-8f86-6e07fa0d10a4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:13.438816 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0791-d911-47d6-8f86-6e07fa0d10a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:13.439094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f0791-d911-47d6-8f86-6e07fa0d10a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:13.439819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f0791-d911-47d6-8f86-6e07fa0d10a4 None admin] RBAC: Adding query filter params (group.id=dce7a1dd2eb0438fac4c478b60c2a991, role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=98ff4b51ad344f35909bb4fdee93bcd4) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:13.440118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f0791-d911-47d6-8f86-6e07fa0d10a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:13.441524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f0791-d911-47d6-8f86-6e07fa0d10a4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:13.451500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 188/383] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:13.454979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 196/384] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Aug 10 22:41:13 2022] GET /identity/v3/role_assignments?group.id=dce7a1dd2eb0438fac4c478b60c2a991&scope.project.id=98ff4b51ad344f35909bb4fdee93bcd4&role.id=edba0d8c079245a38a321d2d77d25419 => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:13.472133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfdaec-77ff-4080-a019-f03ebede9a58 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:13.569692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:13.628790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfdaec-77ff-4080-a019-f03ebede9a58 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:13.664939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c4c19-2b05-4a6c-9a9a-f6892d0f5d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:13.665656 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c4c19-2b05-4a6c-9a9a-f6892d0f5d0f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:13.665935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c4c19-2b05-4a6c-9a9a-f6892d0f5d0f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:13.666200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c4c19-2b05-4a6c-9a9a-f6892d0f5d0f None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:13.667316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c4c19-2b05-4a6c-9a9a-f6892d0f5d0f None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:13.668789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c4c19-2b05-4a6c-9a9a-f6892d0f5d0f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:13.670760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 189/385] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:13 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:13.676217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0791-d911-47d6-8f86-6e07fa0d10a4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:13.690144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:13.784962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f0791-d911-47d6-8f86-6e07fa0d10a4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:13.822352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7045f-3481-4f90-9b7e-881ae2f009a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:13.822982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7045f-3481-4f90-9b7e-881ae2f009a7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:13.823255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7045f-3481-4f90-9b7e-881ae2f009a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:13.823524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7045f-3481-4f90-9b7e-881ae2f009a7 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:13.824629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7045f-3481-4f90-9b7e-881ae2f009a7 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:13.826111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7045f-3481-4f90-9b7e-881ae2f009a7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:13.828164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 197/386] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:13 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:13.833774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c4c19-2b05-4a6c-9a9a-f6892d0f5d0f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:13.957584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c4c19-2b05-4a6c-9a9a-f6892d0f5d0f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:13.984428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:14.001516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a307e2-5b13-4ed3-8917-5aff8cd4fe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:14.002946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a307e2-5b13-4ed3-8917-5aff8cd4fe82 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:14.002946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a307e2-5b13-4ed3-8917-5aff8cd4fe82 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:14.002946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a307e2-5b13-4ed3-8917-5aff8cd4fe82 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272/groups/9f2b0abf646748adb67ea52b7c2bc199/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:14.004605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a307e2-5b13-4ed3-8917-5aff8cd4fe82 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3806275c2874038ad80b383d2238272, group_id=9f2b0abf646748adb67ea52b7c2bc199, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:14.006623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a307e2-5b13-4ed3-8917-5aff8cd4fe82 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:14.080764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 190/387] 10.222.0.77 () {58 vars in 1442 bytes} [Wed Aug 10 22:41:13 2022] PUT /identity/v3/projects/c3806275c2874038ad80b383d2238272/groups/9f2b0abf646748adb67ea52b7c2bc199/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:14.270019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae6e1a-47d4-4faa-8b42-95b0ac64de74 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:14.270388 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae6e1a-47d4-4faa-8b42-95b0ac64de74 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:14.270662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae6e1a-47d4-4faa-8b42-95b0ac64de74 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:14.272861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 198/388] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:14.278215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1d51c-625a-4c3e-8795-048e6090a84c None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:14.278730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1d51c-625a-4c3e-8795-048e6090a84c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:14.278730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1d51c-625a-4c3e-8795-048e6090a84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:14.302499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-66b1d51c-625a-4c3e-8795-048e6090a84c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:14.303768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-66b1d51c-625a-4c3e-8795-048e6090a84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:14.386082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 191/389] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:14.408720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae6e1a-47d4-4faa-8b42-95b0ac64de74 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:14.509660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:14.541981 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae6e1a-47d4-4faa-8b42-95b0ac64de74 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:14.549905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006036-7f24-421d-9b4e-3db9df2318a9 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:14.550528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006036-7f24-421d-9b4e-3db9df2318a9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:14.550997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0006036-7f24-421d-9b4e-3db9df2318a9 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:14.553952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 192/390] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:14.558948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199f9ac-9da8-4d6c-97cd-1c3183da72ee None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:14.559512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199f9ac-9da8-4d6c-97cd-1c3183da72ee None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:14.559982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199f9ac-9da8-4d6c-97cd-1c3183da72ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:14.580975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e199f9ac-9da8-4d6c-97cd-1c3183da72ee None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:14.582525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e199f9ac-9da8-4d6c-97cd-1c3183da72ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:14.620633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607ed59-8875-465c-890a-9fce6c4fddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:14.621664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ed59-8875-465c-890a-9fce6c4fddf3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:14.622136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ed59-8875-465c-890a-9fce6c4fddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:14.622774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607ed59-8875-465c-890a-9fce6c4fddf3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:14.644452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607ed59-8875-465c-890a-9fce6c4fddf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-d607ed59-8875-465c-890a-9fce6c4fddf3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:14.650936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:14.651843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:14.653063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 199/391] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:41:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:14.658435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607ed59-8875-465c-890a-9fce6c4fddf3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:14.702287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 193/392] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:14.755901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199f9ac-9da8-4d6c-97cd-1c3183da72ee None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:14.814498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:14.845709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607ed59-8875-465c-890a-9fce6c4fddf3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:14.890267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3b6df-497e-4298-a1aa-98b03ebdbad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:14.890872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3b6df-497e-4298-a1aa-98b03ebdbad9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:14.891143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3b6df-497e-4298-a1aa-98b03ebdbad9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:14.891410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3b6df-497e-4298-a1aa-98b03ebdbad9 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:14.892065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3b6df-497e-4298-a1aa-98b03ebdbad9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:14.892360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3b6df-497e-4298-a1aa-98b03ebdbad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:14.893751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3b6df-497e-4298-a1aa-98b03ebdbad9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:14.899565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:14.903702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 200/393] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:14.906224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199f9ac-9da8-4d6c-97cd-1c3183da72ee None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:14.910267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3b6df-497e-4298-a1aa-98b03ebdbad9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:14.973228 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e75c3-48b2-4e4a-9139-2bdd644cf994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:14.974750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e75c3-48b2-4e4a-9139-2bdd644cf994 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:14.976547 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e75c3-48b2-4e4a-9139-2bdd644cf994 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:14.977616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e75c3-48b2-4e4a-9139-2bdd644cf994 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:14.998653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e75c3-48b2-4e4a-9139-2bdd644cf994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-7a9e75c3-48b2-4e4a-9139-2bdd644cf994 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:15.005670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:15.006569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:15.007365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:15.014524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 194/394] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:15.021474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e75c3-48b2-4e4a-9139-2bdd644cf994 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:15.093468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3b6df-497e-4298-a1aa-98b03ebdbad9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:15.155913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5144af-ce2d-4ca5-9069-72beccbdc9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:15.156543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5144af-ce2d-4ca5-9069-72beccbdc9ae None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.156812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5144af-ce2d-4ca5-9069-72beccbdc9ae None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.157077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5144af-ce2d-4ca5-9069-72beccbdc9ae None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.159253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5144af-ce2d-4ca5-9069-72beccbdc9ae None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:15.160704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5144af-ce2d-4ca5-9069-72beccbdc9ae None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:15.162998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 201/395] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:14 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:15.164137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d551-f48c-40b5-8a78-7ad79296d750 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.164408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d551-f48c-40b5-8a78-7ad79296d750 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.164677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d551-f48c-40b5-8a78-7ad79296d750 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.166032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 202/396] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:15.170186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d551-f48c-40b5-8a78-7ad79296d750 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:15.186342 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:15.190510 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e75c3-48b2-4e4a-9139-2bdd644cf994 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:15.228692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e96d-bb24-4399-861f-43ec40a6ff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:15.229457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e96d-bb24-4399-861f-43ec40a6ff70 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.229687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e96d-bb24-4399-861f-43ec40a6ff70 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.229952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e96d-bb24-4399-861f-43ec40a6ff70 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.230609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636e96d-bb24-4399-861f-43ec40a6ff70 None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:15.230904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636e96d-bb24-4399-861f-43ec40a6ff70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:15.232252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636e96d-bb24-4399-861f-43ec40a6ff70 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:15.244215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 195/397] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:15.245745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44b27-cec8-42bb-b5e2-693feb79776c None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.246015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44b27-cec8-42bb-b5e2-693feb79776c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.246278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44b27-cec8-42bb-b5e2-693feb79776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.250099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:15.275014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9cf44b27-cec8-42bb-b5e2-693feb79776c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:15.276200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9cf44b27-cec8-42bb-b5e2-693feb79776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:15.296765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d551-f48c-40b5-8a78-7ad79296d750 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:15.339798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef61273-1881-4407-b57b-cc9c9dcddf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:15.340998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef61273-1881-4407-b57b-cc9c9dcddf13 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.341505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef61273-1881-4407-b57b-cc9c9dcddf13 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.341915 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef61273-1881-4407-b57b-cc9c9dcddf13 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.343404 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef61273-1881-4407-b57b-cc9c9dcddf13 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:15.345193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef61273-1881-4407-b57b-cc9c9dcddf13 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:15.348043 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 203/398] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:15 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:15.348826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef61273-1881-4407-b57b-cc9c9dcddf13 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:15.356585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 196/399] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:15.358240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf44b27-cec8-42bb-b5e2-693feb79776c None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:15.463436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:15.475084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf44b27-cec8-42bb-b5e2-693feb79776c None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:15.483190 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef61273-1881-4407-b57b-cc9c9dcddf13 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:15.513997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28d80-548c-4537-90c0-f9251f9de46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:15.514657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28d80-548c-4537-90c0-f9251f9de46a None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.515050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28d80-548c-4537-90c0-f9251f9de46a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.515323 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28d80-548c-4537-90c0-f9251f9de46a None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272/groups/9f2b0abf646748adb67ea52b7c2bc199/roles/6654493feb544c46aeca606d309a1af2` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.517686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28d80-548c-4537-90c0-f9251f9de46a None admin] RBAC: Authorizing `identity:create_grant(project_id=c3806275c2874038ad80b383d2238272, group_id=9f2b0abf646748adb67ea52b7c2bc199, role_id=6654493feb544c46aeca606d309a1af2)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:15.519293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28d80-548c-4537-90c0-f9251f9de46a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:15.520244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa154f-bab9-4bf4-8453-53095913c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:15.521455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa154f-bab9-4bf4-8453-53095913c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.521731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa154f-bab9-4bf4-8453-53095913c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.522002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa154f-bab9-4bf4-8453-53095913c7d3 None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.523822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa154f-bab9-4bf4-8453-53095913c7d3 None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:15.525535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa154f-bab9-4bf4-8453-53095913c7d3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:15.527314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 204/400] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:15 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:15.527882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa154f-bab9-4bf4-8453-53095913c7d3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:15.531703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:15.597496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 197/401] 10.222.0.77 () {58 vars in 1442 bytes} [Wed Aug 10 22:41:15 2022] PUT /identity/v3/projects/c3806275c2874038ad80b383d2238272/groups/9f2b0abf646748adb67ea52b7c2bc199/roles/6654493feb544c46aeca606d309a1af2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:15.598941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28d80-548c-4537-90c0-f9251f9de46a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:15.641702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa154f-bab9-4bf4-8453-53095913c7d3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:15.682264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fbddb-6736-448e-bedc-c23afea7ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:15.682979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fbddb-6736-448e-bedc-c23afea7ff8b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.683395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fbddb-6736-448e-bedc-c23afea7ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.684005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fbddb-6736-448e-bedc-c23afea7ff8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.704076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fbddb-6736-448e-bedc-c23afea7ff8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a60fbddb-6736-448e-bedc-c23afea7ff8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:15.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:15.711733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:15.712704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:15.714612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 205/402] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:41:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:15.720514 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fbddb-6736-448e-bedc-c23afea7ff8b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:15.739358 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28d80-548c-4537-90c0-f9251f9de46a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:15.786950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e0d80-f202-491d-bd34-51ccb383d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:15.787885 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e0d80-f202-491d-bd34-51ccb383d519 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.788309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e0d80-f202-491d-bd34-51ccb383d519 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.788723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e0d80-f202-491d-bd34-51ccb383d519 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.790739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e0d80-f202-491d-bd34-51ccb383d519 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:15.792894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e0d80-f202-491d-bd34-51ccb383d519 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:15.795591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 198/403] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:15 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:15.800604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:15.802609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e0d80-f202-491d-bd34-51ccb383d519 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:15.832040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:15.846831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fbddb-6736-448e-bedc-c23afea7ff8b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:15.887922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffae566-7680-4aea-8ecf-348a4cd6ca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:15.888636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae566-7680-4aea-8ecf-348a4cd6ca01 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.889003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae566-7680-4aea-8ecf-348a4cd6ca01 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.889435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffae566-7680-4aea-8ecf-348a4cd6ca01 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.890276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffae566-7680-4aea-8ecf-348a4cd6ca01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:15.890668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffae566-7680-4aea-8ecf-348a4cd6ca01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:15.892214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffae566-7680-4aea-8ecf-348a4cd6ca01 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:15.902269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 206/404] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:15.908864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffae566-7680-4aea-8ecf-348a4cd6ca01 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:15.945444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e0d80-f202-491d-bd34-51ccb383d519 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:15.986796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b988f1d-2d66-4673-a293-05feb37a7ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:15.987773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b988f1d-2d66-4673-a293-05feb37a7ac3 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:15.988199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b988f1d-2d66-4673-a293-05feb37a7ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:15.988606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b988f1d-2d66-4673-a293-05feb37a7ac3 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/groups/9f2b0abf646748adb67ea52b7c2bc199/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:15.991641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b988f1d-2d66-4673-a293-05feb37a7ac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a25b4d45c4d04b1caa0854b2777fecbf, group_id=9f2b0abf646748adb67ea52b7c2bc199, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:15.993431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b988f1d-2d66-4673-a293-05feb37a7ac3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:16.035815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffae566-7680-4aea-8ecf-348a4cd6ca01 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:16.065984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:16.075332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b30952-c59a-4962-a964-fe403a4be6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:16.076234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b30952-c59a-4962-a964-fe403a4be6cf None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:16.076681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b30952-c59a-4962-a964-fe403a4be6cf None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:16.077140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b30952-c59a-4962-a964-fe403a4be6cf None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:16.078453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b30952-c59a-4962-a964-fe403a4be6cf None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:16.083453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b30952-c59a-4962-a964-fe403a4be6cf None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:16.085758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 207/405] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:15 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:16.093439 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 199/406] 10.222.0.77 () {58 vars in 1442 bytes} [Wed Aug 10 22:41:15 2022] PUT /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/groups/9f2b0abf646748adb67ea52b7c2bc199/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:16.093592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e45a0-68dd-414f-8863-1721df0222f5 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:16.093592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e45a0-68dd-414f-8863-1721df0222f5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:16.093592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e45a0-68dd-414f-8863-1721df0222f5 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:16.093592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 208/407] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:16.095388 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b988f1d-2d66-4673-a293-05feb37a7ac3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:16.097352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e76067-13e7-429d-947c-2d0b723db9cd None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:16.097651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e76067-13e7-429d-947c-2d0b723db9cd None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:16.097956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e76067-13e7-429d-947c-2d0b723db9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:16.126025 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-95e76067-13e7-429d-947c-2d0b723db9cd None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:16.127413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-95e76067-13e7-429d-947c-2d0b723db9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:16.223396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 209/408] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:16.280415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:16.281967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e76067-13e7-429d-947c-2d0b723db9cd None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:16.321749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b988f1d-2d66-4673-a293-05feb37a7ac3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:16.383531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626330b2-094b-42ed-8e9d-9f7268ebf96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:16.384158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626330b2-094b-42ed-8e9d-9f7268ebf96b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:16.384414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626330b2-094b-42ed-8e9d-9f7268ebf96b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:16.384681 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626330b2-094b-42ed-8e9d-9f7268ebf96b None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:16.387421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626330b2-094b-42ed-8e9d-9f7268ebf96b None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:16.389205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626330b2-094b-42ed-8e9d-9f7268ebf96b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:16.391080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 200/409] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:16 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:16.403894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626330b2-094b-42ed-8e9d-9f7268ebf96b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:16.462938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e76067-13e7-429d-947c-2d0b723db9cd None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:16.520200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:16.552952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626330b2-094b-42ed-8e9d-9f7268ebf96b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:16.556447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0b6f6-5e63-430e-800d-5dc9dcb79477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:16.558096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b6f6-5e63-430e-800d-5dc9dcb79477 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:16.558416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b6f6-5e63-430e-800d-5dc9dcb79477 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:16.559227 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b6f6-5e63-430e-800d-5dc9dcb79477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:16.574710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0b6f6-5e63-430e-800d-5dc9dcb79477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-0ec0b6f6-5e63-430e-800d-5dc9dcb79477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:16.579697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:16.580777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:16.581810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:16.584276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 210/410] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:41:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:16.586153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a88b-4adf-4cba-a4b8-2e95043b55b1 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:16.586528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a88b-4adf-4cba-a4b8-2e95043b55b1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:16.586888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a88b-4adf-4cba-a4b8-2e95043b55b1 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:16.588563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 211/411] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:16.589899 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771a88b-4adf-4cba-a4b8-2e95043b55b1 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:16.601417 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149375a-5867-4c4f-8aa3-311576ee9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:16.602331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149375a-5867-4c4f-8aa3-311576ee9106 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:16.602772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149375a-5867-4c4f-8aa3-311576ee9106 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:16.603658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149375a-5867-4c4f-8aa3-311576ee9106 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/groups/9f2b0abf646748adb67ea52b7c2bc199/roles/6654493feb544c46aeca606d309a1af2` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:16.607036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149375a-5867-4c4f-8aa3-311576ee9106 None admin] RBAC: Authorizing `identity:create_grant(project_id=a25b4d45c4d04b1caa0854b2777fecbf, group_id=9f2b0abf646748adb67ea52b7c2bc199, role_id=6654493feb544c46aeca606d309a1af2)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:16.609734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149375a-5867-4c4f-8aa3-311576ee9106 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:16.677273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 201/412] 10.222.0.77 () {58 vars in 1442 bytes} [Wed Aug 10 22:41:16 2022] PUT /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf/groups/9f2b0abf646748adb67ea52b7c2bc199/roles/6654493feb544c46aeca606d309a1af2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 22:41:16.678955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec128b-313d-4f76-9f60-a69c75804df2 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:16.679403 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec128b-313d-4f76-9f60-a69c75804df2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:16.679821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec128b-313d-4f76-9f60-a69c75804df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:16.705926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-05ec128b-313d-4f76-9f60-a69c75804df2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:16.707727 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-05ec128b-313d-4f76-9f60-a69c75804df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:16.714034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:16.717955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771a88b-4adf-4cba-a4b8-2e95043b55b1 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:16.763618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37343-0b26-4e3b-9bff-2882f7445e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:16.764618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37343-0b26-4e3b-9bff-2882f7445e43 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:16.765034 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37343-0b26-4e3b-9bff-2882f7445e43 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:16.765446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37343-0b26-4e3b-9bff-2882f7445e43 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:16.766435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37343-0b26-4e3b-9bff-2882f7445e43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:16.766925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37343-0b26-4e3b-9bff-2882f7445e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:16.768937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37343-0b26-4e3b-9bff-2882f7445e43 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:16.781022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 212/413] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:16.791461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37343-0b26-4e3b-9bff-2882f7445e43 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:16.803425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 202/414] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:16.834352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec128b-313d-4f76-9f60-a69c75804df2 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:16.856718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:16.923593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37343-0b26-4e3b-9bff-2882f7445e43 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:16.965193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79ce6f-68ef-4de6-9fb4-413c912ba992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:16.965894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79ce6f-68ef-4de6-9fb4-413c912ba992 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:16.966251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79ce6f-68ef-4de6-9fb4-413c912ba992 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:16.966699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79ce6f-68ef-4de6-9fb4-413c912ba992 None admin] PATH_INFO: `/v3/groups/dce7a1dd2eb0438fac4c478b60c2a991` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:16.967823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79ce6f-68ef-4de6-9fb4-413c912ba992 None admin] RBAC: Authorizing `identity:get_group(group_id=dce7a1dd2eb0438fac4c478b60c2a991)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:16.969425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79ce6f-68ef-4de6-9fb4-413c912ba992 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:16.971430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 213/415] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:16 2022] GET /identity/v3/groups/dce7a1dd2eb0438fac4c478b60c2a991 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:16.977563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79ce6f-68ef-4de6-9fb4-413c912ba992 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:16.988918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec128b-313d-4f76-9f60-a69c75804df2 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:17.078797 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112322b0-2ffd-4e8d-b002-66dcba12f4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:17.079745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112322b0-2ffd-4e8d-b002-66dcba12f4e1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:17.080207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112322b0-2ffd-4e8d-b002-66dcba12f4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:17.080655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112322b0-2ffd-4e8d-b002-66dcba12f4e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:17.094381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79ce6f-68ef-4de6-9fb4-413c912ba992 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:17.103304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:17.112697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112322b0-2ffd-4e8d-b002-66dcba12f4e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:17.112909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-112322b0-2ffd-4e8d-b002-66dcba12f4e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:17.118796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:17.119692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:17.120478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:17.129344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 203/416] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:17.131086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112322b0-2ffd-4e8d-b002-66dcba12f4e1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:17.137441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e26f7-8f9b-426a-9d3d-9746e6e3a10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:17.138137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e26f7-8f9b-426a-9d3d-9746e6e3a10a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:17.138418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e26f7-8f9b-426a-9d3d-9746e6e3a10a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:17.138694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e26f7-8f9b-426a-9d3d-9746e6e3a10a None admin] PATH_INFO: `/v3/projects/98ff4b51ad344f35909bb4fdee93bcd4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:17.139968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e26f7-8f9b-426a-9d3d-9746e6e3a10a None admin] RBAC: Authorizing `identity:get_project(project_id=98ff4b51ad344f35909bb4fdee93bcd4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:17.141453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e26f7-8f9b-426a-9d3d-9746e6e3a10a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:17.143513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 214/417] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:16 2022] GET /identity/v3/projects/98ff4b51ad344f35909bb4fdee93bcd4 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:17.153318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e26f7-8f9b-426a-9d3d-9746e6e3a10a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:17.265627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e26f7-8f9b-426a-9d3d-9746e6e3a10a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:17.305653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0139d33-2198-4b92-9ffa-717f58402fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:17.306322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0139d33-2198-4b92-9ffa-717f58402fe1 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:17.306602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0139d33-2198-4b92-9ffa-717f58402fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:17.306877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0139d33-2198-4b92-9ffa-717f58402fe1 None admin] PATH_INFO: `/v3/projects/98ff4b51ad344f35909bb4fdee93bcd4/groups/dce7a1dd2eb0438fac4c478b60c2a991/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:17.308965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0139d33-2198-4b92-9ffa-717f58402fe1 None admin] RBAC: Authorizing `identity:create_grant(project_id=98ff4b51ad344f35909bb4fdee93bcd4, group_id=dce7a1dd2eb0438fac4c478b60c2a991, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:17.310637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0139d33-2198-4b92-9ffa-717f58402fe1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:17.350791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112322b0-2ffd-4e8d-b002-66dcba12f4e1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:17.395200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba5999-1793-4a49-972b-28165406a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:17.395837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba5999-1793-4a49-972b-28165406a41b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:17.396212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba5999-1793-4a49-972b-28165406a41b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:17.396488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba5999-1793-4a49-972b-28165406a41b None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:17.397212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba5999-1793-4a49-972b-28165406a41b None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:17.397543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba5999-1793-4a49-972b-28165406a41b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:17.398960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba5999-1793-4a49-972b-28165406a41b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:17.408763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 204/418] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:17.413909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba5999-1793-4a49-972b-28165406a41b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:17.417117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 215/419] 10.222.0.77 () {58 vars in 1442 bytes} [Wed Aug 10 22:41:17 2022] PUT /identity/v3/projects/98ff4b51ad344f35909bb4fdee93bcd4/groups/dce7a1dd2eb0438fac4c478b60c2a991/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:17.505690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:17.554960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba5999-1793-4a49-972b-28165406a41b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:17.604417 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd3de4-3ff7-4c92-820f-052085a1a7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:17.604951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd3de4-3ff7-4c92-820f-052085a1a7f1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:17.605229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd3de4-3ff7-4c92-820f-052085a1a7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:17.609733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd3de4-3ff7-4c92-820f-052085a1a7f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:17.690392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd3de4-3ff7-4c92-820f-052085a1a7f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:17.691849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd3de4-3ff7-4c92-820f-052085a1a7f1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:17.754297 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:17.799737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 205/420] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 22:41:17.805474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0139d33-2198-4b92-9ffa-717f58402fe1 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:17.860975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:17.934888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0139d33-2198-4b92-9ffa-717f58402fe1 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:17.979030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e29d7c-75e4-4662-8328-19ee631d3a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:17.979661 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29d7c-75e4-4662-8328-19ee631d3a0f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:17.979938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29d7c-75e4-4662-8328-19ee631d3a0f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:17.980209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e29d7c-75e4-4662-8328-19ee631d3a0f None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:17.981369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e29d7c-75e4-4662-8328-19ee631d3a0f None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:17.982868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e29d7c-75e4-4662-8328-19ee631d3a0f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:17.984804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 216/421] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:17 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:17.990002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd3de4-3ff7-4c92-820f-052085a1a7f1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:18.125966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab374f-894f-43e2-90de-9b1d2f9e511b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:18.126141 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab374f-894f-43e2-90de-9b1d2f9e511b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:18.126425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab374f-894f-43e2-90de-9b1d2f9e511b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:18.128238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 217/422] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:18.136272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd3de4-3ff7-4c92-820f-052085a1a7f1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:18.142307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888d15-a595-470f-b3da-092f28d1d481 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:18.142589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888d15-a595-470f-b3da-092f28d1d481 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:18.142854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa888d15-a595-470f-b3da-092f28d1d481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:18.174447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-aa888d15-a595-470f-b3da-092f28d1d481 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:18.175666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aa888d15-a595-470f-b3da-092f28d1d481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:18.207094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff28a-7de2-4fcf-9a70-73426281f9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:18.207725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff28a-7de2-4fcf-9a70-73426281f9bf None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:18.207998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff28a-7de2-4fcf-9a70-73426281f9bf None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:18.208788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acff28a-7de2-4fcf-9a70-73426281f9bf None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:18.209970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acff28a-7de2-4fcf-9a70-73426281f9bf None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:18.211417 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acff28a-7de2-4fcf-9a70-73426281f9bf None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:18.213003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 206/423] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:17 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:18.220224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff28a-7de2-4fcf-9a70-73426281f9bf None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:18.274069 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:18.297812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 218/424] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:41:18.325087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa888d15-a595-470f-b3da-092f28d1d481 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:18.372873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:18.403143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acff28a-7de2-4fcf-9a70-73426281f9bf None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:18.470288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2a16e-cf37-46d5-a09b-837378eee5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:18.470895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a16e-cf37-46d5-a09b-837378eee5f9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:18.471167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a16e-cf37-46d5-a09b-837378eee5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:18.471435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a16e-cf37-46d5-a09b-837378eee5f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:18.472420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2a16e-cf37-46d5-a09b-837378eee5f9 None admin] RBAC: Adding query filter params (group.id=9f2b0abf646748adb67ea52b7c2bc199, role.id=ec8d0b12e5324b00bca50fea232c8690, scope.project.id=c3806275c2874038ad80b383d2238272) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:18.472720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2a16e-cf37-46d5-a09b-837378eee5f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:18.474199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2a16e-cf37-46d5-a09b-837378eee5f9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:18.494273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 207/425] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Aug 10 22:41:18 2022] GET /identity/v3/role_assignments?group.id=9f2b0abf646748adb67ea52b7c2bc199&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 611 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:18.496503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa888d15-a595-470f-b3da-092f28d1d481 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:18.564196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70eb16-f8fe-48ee-9a0a-76fa4d1d6d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:18.564855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70eb16-f8fe-48ee-9a0a-76fa4d1d6d54 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:18.565130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70eb16-f8fe-48ee-9a0a-76fa4d1d6d54 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:18.565427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70eb16-f8fe-48ee-9a0a-76fa4d1d6d54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:18.588830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70eb16-f8fe-48ee-9a0a-76fa4d1d6d54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-af70eb16-f8fe-48ee-9a0a-76fa4d1d6d54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:18.593880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:18.594810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:18.595581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 219/426] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:41:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:18.601496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2a16e-cf37-46d5-a09b-837378eee5f9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:18.712294 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:18.721247 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2a16e-cf37-46d5-a09b-837378eee5f9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:18.758013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dec627-b1a8-4cdf-b678-23c9cdfc2834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:18.758618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dec627-b1a8-4cdf-b678-23c9cdfc2834 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:18.758894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dec627-b1a8-4cdf-b678-23c9cdfc2834 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:18.759162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dec627-b1a8-4cdf-b678-23c9cdfc2834 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:18.759824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dec627-b1a8-4cdf-b678-23c9cdfc2834 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:18.760123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dec627-b1a8-4cdf-b678-23c9cdfc2834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:18.761524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dec627-b1a8-4cdf-b678-23c9cdfc2834 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:18.770151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 208/427] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:18.775868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70eb16-f8fe-48ee-9a0a-76fa4d1d6d54 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:18.825543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1354b4-0a6f-4bcb-ae18-48458911680d None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:18.825859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1354b4-0a6f-4bcb-ae18-48458911680d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:18.826076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1354b4-0a6f-4bcb-ae18-48458911680d None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:18.830780 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 209/428] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:41:18.839836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e8cbb-f231-4673-a903-3f08f781fb5e None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:18.840206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e8cbb-f231-4673-a903-3f08f781fb5e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:18.840542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e8cbb-f231-4673-a903-3f08f781fb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:18.860066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-685e8cbb-f231-4673-a903-3f08f781fb5e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:18.861392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-685e8cbb-f231-4673-a903-3f08f781fb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:18.891312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:18.895641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70eb16-f8fe-48ee-9a0a-76fa4d1d6d54 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:18.934213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39f8f3-5be9-4e58-b7cb-80c9232bcec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:18.934820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f8f3-5be9-4e58-b7cb-80c9232bcec4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:18.935097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f8f3-5be9-4e58-b7cb-80c9232bcec4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:18.935366 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f8f3-5be9-4e58-b7cb-80c9232bcec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:18.941479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 210/429] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:41:18.960044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e8cbb-f231-4673-a903-3f08f781fb5e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:19.029334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39f8f3-5be9-4e58-b7cb-80c9232bcec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:19.031191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39f8f3-5be9-4e58-b7cb-80c9232bcec4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:19.088265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:19.109561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e8cbb-f231-4673-a903-3f08f781fb5e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:19.149641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7efecb-9668-43ee-ba3a-c9b9b960d2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:19.150680 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7efecb-9668-43ee-ba3a-c9b9b960d2da None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:19.151179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7efecb-9668-43ee-ba3a-c9b9b960d2da None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:19.151658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7efecb-9668-43ee-ba3a-c9b9b960d2da None admin] PATH_INFO: `/v3/roles/member` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:19.158460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:19.164208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 220/430] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:19.165364 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822a870-2436-41bf-b1ab-988f5939f9b0 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:19.165660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822a870-2436-41bf-b1ab-988f5939f9b0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:19.168567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822a870-2436-41bf-b1ab-988f5939f9b0 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:19.168694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7efecb-9668-43ee-ba3a-c9b9b960d2da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:19.168772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 221/431] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:19.170361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822a870-2436-41bf-b1ab-988f5939f9b0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-dd7efecb-9668-43ee-ba3a-c9b9b960d2da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:19.174709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:19.175614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 22:41:19.176394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:19.178525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 211/432] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:19.181170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93716-ad6e-43ed-b8f8-23a967c3c6d2 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:19.181595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93716-ad6e-43ed-b8f8-23a967c3c6d2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:19.181872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a93716-ad6e-43ed-b8f8-23a967c3c6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:19.202984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-69a93716-ad6e-43ed-b8f8-23a967c3c6d2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:19.204293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-69a93716-ad6e-43ed-b8f8-23a967c3c6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:19.295144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 212/433] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:19.298570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93716-ad6e-43ed-b8f8-23a967c3c6d2 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:19.312176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822a870-2436-41bf-b1ab-988f5939f9b0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:19.356727 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d736f-44ad-45d5-81a3-b104ef873107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:19.373586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d736f-44ad-45d5-81a3-b104ef873107 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:19.373586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d736f-44ad-45d5-81a3-b104ef873107 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:19.373586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d736f-44ad-45d5-81a3-b104ef873107 None admin] PATH_INFO: `/v3/projects/c3806275c2874038ad80b383d2238272` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:19.373586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d736f-44ad-45d5-81a3-b104ef873107 None admin] RBAC: Authorizing `identity:get_project(project_id=c3806275c2874038ad80b383d2238272)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:19.373586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d736f-44ad-45d5-81a3-b104ef873107 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:19.373586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 222/434] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:19 2022] GET /identity/v3/projects/c3806275c2874038ad80b383d2238272 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:19.374113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d736f-44ad-45d5-81a3-b104ef873107 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:19.391870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:19.416935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a93716-ad6e-43ed-b8f8-23a967c3c6d2 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:19.444733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:19.452692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61efc40-6c9c-44b2-b36e-c26ff05caeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:19.453354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61efc40-6c9c-44b2-b36e-c26ff05caeb5 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:19.454623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61efc40-6c9c-44b2-b36e-c26ff05caeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:19.454623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61efc40-6c9c-44b2-b36e-c26ff05caeb5 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:19.454623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61efc40-6c9c-44b2-b36e-c26ff05caeb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:19.454830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61efc40-6c9c-44b2-b36e-c26ff05caeb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:19.456145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61efc40-6c9c-44b2-b36e-c26ff05caeb5 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:19.469409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 213/435] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:41:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:19.469409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61efc40-6c9c-44b2-b36e-c26ff05caeb5 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:19.480953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d736f-44ad-45d5-81a3-b104ef873107 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:19.518031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c525-0416-48eb-96bf-0aa0a5963a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:19.518686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c525-0416-48eb-96bf-0aa0a5963a1b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:19.519201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c525-0416-48eb-96bf-0aa0a5963a1b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:19.519201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c525-0416-48eb-96bf-0aa0a5963a1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:19.530688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5c525-0416-48eb-96bf-0aa0a5963a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-8cc5c525-0416-48eb-96bf-0aa0a5963a1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:19.535682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:19.537188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:19.538098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 223/436] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:41:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:19.538765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c525-0416-48eb-96bf-0aa0a5963a1b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:19.589373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61efc40-6c9c-44b2-b36e-c26ff05caeb5 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:19.625809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec77db-8d90-4401-ab8e-1f1e1f48b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:19.626437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec77db-8d90-4401-ab8e-1f1e1f48b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:19.626705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec77db-8d90-4401-ab8e-1f1e1f48b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:19.626969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec77db-8d90-4401-ab8e-1f1e1f48b1b7 None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:19.628074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec77db-8d90-4401-ab8e-1f1e1f48b1b7 None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:19.629511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec77db-8d90-4401-ab8e-1f1e1f48b1b7 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:19.631446 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 214/437] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:19 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:19.631989 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec77db-8d90-4401-ab8e-1f1e1f48b1b7 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:19.635650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:19.646685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c525-0416-48eb-96bf-0aa0a5963a1b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:19.674941 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:19.683276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb2cb8-5dcf-4427-8aa3-5773ba1a42fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:19.683966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb2cb8-5dcf-4427-8aa3-5773ba1a42fe None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:19.684249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb2cb8-5dcf-4427-8aa3-5773ba1a42fe None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:19.684521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb2cb8-5dcf-4427-8aa3-5773ba1a42fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:19.738552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec77db-8d90-4401-ab8e-1f1e1f48b1b7 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:19.758062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb2cb8-5dcf-4427-8aa3-5773ba1a42fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:19.759521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb2cb8-5dcf-4427-8aa3-5773ba1a42fe None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:19.778887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aeb0f-1fda-499b-8d56-9bfb45998bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:19.779870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aeb0f-1fda-499b-8d56-9bfb45998bd5 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:19.780460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aeb0f-1fda-499b-8d56-9bfb45998bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:19.780787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aeb0f-1fda-499b-8d56-9bfb45998bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:19.781515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aeb0f-1fda-499b-8d56-9bfb45998bd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:19.781817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aeb0f-1fda-499b-8d56-9bfb45998bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:19.783452 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aeb0f-1fda-499b-8d56-9bfb45998bd5 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:19.797824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 215/438] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:19.797824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aeb0f-1fda-499b-8d56-9bfb45998bd5 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:19.866407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:19.871913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 224/439] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:19.871913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb2cb8-5dcf-4427-8aa3-5773ba1a42fe None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:19.899719 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:19.910279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aeb0f-1fda-499b-8d56-9bfb45998bd5 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:19.945431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100492-3b7a-48f3-a78b-4f3c2477ce09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:19.946260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100492-3b7a-48f3-a78b-4f3c2477ce09 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:19.946671 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100492-3b7a-48f3-a78b-4f3c2477ce09 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:19.947103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100492-3b7a-48f3-a78b-4f3c2477ce09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:19.947953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100492-3b7a-48f3-a78b-4f3c2477ce09 None admin] RBAC: Adding query filter params (group.id=9f2b0abf646748adb67ea52b7c2bc199, role.id=6654493feb544c46aeca606d309a1af2, scope.project.id=c3806275c2874038ad80b383d2238272) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:19.948406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100492-3b7a-48f3-a78b-4f3c2477ce09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:19.949849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100492-3b7a-48f3-a78b-4f3c2477ce09 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:19.955830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 216/440] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Aug 10 22:41:19 2022] GET /identity/v3/role_assignments?group.id=9f2b0abf646748adb67ea52b7c2bc199&scope.project.id=c3806275c2874038ad80b383d2238272&role.id=6654493feb544c46aeca606d309a1af2 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:19.956640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100492-3b7a-48f3-a78b-4f3c2477ce09 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:19.991158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb2cb8-5dcf-4427-8aa3-5773ba1a42fe None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:20.038415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993578f0-c178-40a9-81fb-3fc3f09b0358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:20.039040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993578f0-c178-40a9-81fb-3fc3f09b0358 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.039322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993578f0-c178-40a9-81fb-3fc3f09b0358 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.039868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993578f0-c178-40a9-81fb-3fc3f09b0358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.079597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100492-3b7a-48f3-a78b-4f3c2477ce09 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:20.116051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:20.122031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306052b-ec87-457b-9946-cb8efc389054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:20.122596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306052b-ec87-457b-9946-cb8efc389054 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.122870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306052b-ec87-457b-9946-cb8efc389054 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.123382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306052b-ec87-457b-9946-cb8efc389054 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.124978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306052b-ec87-457b-9946-cb8efc389054 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:20.126392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993578f0-c178-40a9-81fb-3fc3f09b0358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:20.126790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306052b-ec87-457b-9946-cb8efc389054 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:20.132826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993578f0-c178-40a9-81fb-3fc3f09b0358 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:20.132940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 217/441] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:19 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:20.132940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbe68f-a612-4f79-b83c-94bb33470a2e None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.132940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbe68f-a612-4f79-b83c-94bb33470a2e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.132940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbe68f-a612-4f79-b83c-94bb33470a2e None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.133392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 218/442] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:20.134646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbe68f-a612-4f79-b83c-94bb33470a2e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:20.161588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:20.245273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 225/443] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:20.246819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93c73d-bddb-4b1b-8e76-5e20f5701dd2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.247244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93c73d-bddb-4b1b-8e76-5e20f5701dd2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.247686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93c73d-bddb-4b1b-8e76-5e20f5701dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.267034 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5f93c73d-bddb-4b1b-8e76-5e20f5701dd2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:20.267380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbe68f-a612-4f79-b83c-94bb33470a2e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:20.268202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5f93c73d-bddb-4b1b-8e76-5e20f5701dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:20.308864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f48d0-a771-41a2-89de-7fd209a28ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:20.308864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f48d0-a771-41a2-89de-7fd209a28ec8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.308864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f48d0-a771-41a2-89de-7fd209a28ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.308864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f48d0-a771-41a2-89de-7fd209a28ec8 None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.310996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f48d0-a771-41a2-89de-7fd209a28ec8 None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:20.311281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f48d0-a771-41a2-89de-7fd209a28ec8 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:20.312871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 219/444] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:20 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:20.315249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f48d0-a771-41a2-89de-7fd209a28ec8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:20.358716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 226/445] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:20.359914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93c73d-bddb-4b1b-8e76-5e20f5701dd2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:20.395156 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:20.422267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:20.428634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f48d0-a771-41a2-89de-7fd209a28ec8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:20.461095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25f56e-4a22-4023-93c0-f5faf7604368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:20.461529 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93c73d-bddb-4b1b-8e76-5e20f5701dd2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:20.461766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f56e-4a22-4023-93c0-f5faf7604368 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.462038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f56e-4a22-4023-93c0-f5faf7604368 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.462328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25f56e-4a22-4023-93c0-f5faf7604368 None admin] PATH_INFO: `/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.463414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25f56e-4a22-4023-93c0-f5faf7604368 None admin] RBAC: Authorizing `identity:get_project(project_id=a25b4d45c4d04b1caa0854b2777fecbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:20.464830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25f56e-4a22-4023-93c0-f5faf7604368 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:20.466482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 220/446] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:20 2022] GET /identity/v3/projects/a25b4d45c4d04b1caa0854b2777fecbf => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:20.467283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25f56e-4a22-4023-93c0-f5faf7604368 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:20.495654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c6783-2fae-49ee-946d-2dcf7fd71645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:20.496251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6783-2fae-49ee-946d-2dcf7fd71645 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.496528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6783-2fae-49ee-946d-2dcf7fd71645 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.496786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6783-2fae-49ee-946d-2dcf7fd71645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.497530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c6783-2fae-49ee-946d-2dcf7fd71645 None admin] RBAC: Adding query filter params (group.id=9f2b0abf646748adb67ea52b7c2bc199, role.id=ec8d0b12e5324b00bca50fea232c8690, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:20.497828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c6783-2fae-49ee-946d-2dcf7fd71645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:20.499309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c6783-2fae-49ee-946d-2dcf7fd71645 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:20.504952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 227/447] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Aug 10 22:41:20 2022] GET /identity/v3/role_assignments?group.id=9f2b0abf646748adb67ea52b7c2bc199&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=ec8d0b12e5324b00bca50fea232c8690 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:20.505809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c6783-2fae-49ee-946d-2dcf7fd71645 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:20.580927 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25f56e-4a22-4023-93c0-f5faf7604368 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:20.621866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb20e9a-3383-440a-8659-d36fe6ac41f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:20.622513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb20e9a-3383-440a-8659-d36fe6ac41f8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.622796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb20e9a-3383-440a-8659-d36fe6ac41f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.623067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb20e9a-3383-440a-8659-d36fe6ac41f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.625781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:20.635859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb20e9a-3383-440a-8659-d36fe6ac41f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:20.636476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c6783-2fae-49ee-946d-2dcf7fd71645 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-dbb20e9a-3383-440a-8659-d36fe6ac41f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:20.642383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:20.643434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:20.644232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 221/448] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:41:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:20.648309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb20e9a-3383-440a-8659-d36fe6ac41f8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:20.666487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:20.681621 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cf2ee-07b5-41ab-ae58-f1e9b6b2a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:20.682334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cf2ee-07b5-41ab-ae58-f1e9b6b2a384 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.682703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cf2ee-07b5-41ab-ae58-f1e9b6b2a384 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.682979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cf2ee-07b5-41ab-ae58-f1e9b6b2a384 None admin] PATH_INFO: `/v3/groups/9f2b0abf646748adb67ea52b7c2bc199` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.684324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cf2ee-07b5-41ab-ae58-f1e9b6b2a384 None admin] RBAC: Authorizing `identity:get_group(group_id=9f2b0abf646748adb67ea52b7c2bc199)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:20.687752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cf2ee-07b5-41ab-ae58-f1e9b6b2a384 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:20.691520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 228/449] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:20 2022] GET /identity/v3/groups/9f2b0abf646748adb67ea52b7c2bc199 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:20.698815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cf2ee-07b5-41ab-ae58-f1e9b6b2a384 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:20.775135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb20e9a-3383-440a-8659-d36fe6ac41f8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:20.822479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650377-b008-4585-95d9-8ac9ad2fb58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:20.823083 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650377-b008-4585-95d9-8ac9ad2fb58a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.823611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650377-b008-4585-95d9-8ac9ad2fb58a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.823877 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a650377-b008-4585-95d9-8ac9ad2fb58a None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.824873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a650377-b008-4585-95d9-8ac9ad2fb58a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:20.825342 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a650377-b008-4585-95d9-8ac9ad2fb58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:20.826711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a650377-b008-4585-95d9-8ac9ad2fb58a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:20.827039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cf2ee-07b5-41ab-ae58-f1e9b6b2a384 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:20.835953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 222/450] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:20.841663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650377-b008-4585-95d9-8ac9ad2fb58a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:20.868500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd85842-233e-445b-a7c8-c8f4e641806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:20.869105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd85842-233e-445b-a7c8-c8f4e641806e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.869421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd85842-233e-445b-a7c8-c8f4e641806e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.869688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd85842-233e-445b-a7c8-c8f4e641806e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:20.870405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd85842-233e-445b-a7c8-c8f4e641806e None admin] RBAC: Adding query filter params (group.id=9f2b0abf646748adb67ea52b7c2bc199, role.id=6654493feb544c46aeca606d309a1af2, scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:20.870708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd85842-233e-445b-a7c8-c8f4e641806e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:20.872127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd85842-233e-445b-a7c8-c8f4e641806e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:20.878298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 229/451] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Aug 10 22:41:20 2022] GET /identity/v3/role_assignments?group.id=9f2b0abf646748adb67ea52b7c2bc199&scope.project.id=a25b4d45c4d04b1caa0854b2777fecbf&role.id=6654493feb544c46aeca606d309a1af2 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:20.909422 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:20.956717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a650377-b008-4585-95d9-8ac9ad2fb58a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:20.992243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70eb26-7206-4739-97fa-7f1615f9e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:20.992842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70eb26-7206-4739-97fa-7f1615f9e1bf None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:20.993112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70eb26-7206-4739-97fa-7f1615f9e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:20.993412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70eb26-7206-4739-97fa-7f1615f9e1bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:21.062579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70eb26-7206-4739-97fa-7f1615f9e1bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:21.064009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70eb26-7206-4739-97fa-7f1615f9e1bf None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:21.119523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:21.164647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 223/452] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 22:41:21.170300 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd85842-233e-445b-a7c8-c8f4e641806e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:21.229674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:21.274758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd85842-233e-445b-a7c8-c8f4e641806e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:21.307448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0350872-2ec1-416f-a939-c50a749700ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:21.308096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350872-2ec1-416f-a939-c50a749700ab None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:21.308367 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350872-2ec1-416f-a939-c50a749700ab None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:21.308632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350872-2ec1-416f-a939-c50a749700ab None admin] PATH_INFO: `/v3/projects/98ff4b51ad344f35909bb4fdee93bcd4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:21.309793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0350872-2ec1-416f-a939-c50a749700ab None admin] RBAC: Authorizing `identity:get_project(project_id=98ff4b51ad344f35909bb4fdee93bcd4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:21.311201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0350872-2ec1-416f-a939-c50a749700ab None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:21.312785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 230/453] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:41:21 2022] GET /identity/v3/projects/98ff4b51ad344f35909bb4fdee93bcd4 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:21.318985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70eb26-7206-4739-97fa-7f1615f9e1bf None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:21.417966 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70eb26-7206-4739-97fa-7f1615f9e1bf None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:21.450705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffe1ec-ab64-4daf-9c43-c25ceba539cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:21.451312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe1ec-ab64-4daf-9c43-c25ceba539cc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:21.451586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe1ec-ab64-4daf-9c43-c25ceba539cc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:21.451858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe1ec-ab64-4daf-9c43-c25ceba539cc None admin] PATH_INFO: `/v3/groups/dce7a1dd2eb0438fac4c478b60c2a991` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:21.452927 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffe1ec-ab64-4daf-9c43-c25ceba539cc None admin] RBAC: Authorizing `identity:get_group(group_id=dce7a1dd2eb0438fac4c478b60c2a991)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:21.454385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffe1ec-ab64-4daf-9c43-c25ceba539cc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:21.455931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 224/454] 10.222.0.77 () {56 vars in 1180 bytes} [Wed Aug 10 22:41:21 2022] GET /identity/v3/groups/dce7a1dd2eb0438fac4c478b60c2a991 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:21.462393 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0350872-2ec1-416f-a939-c50a749700ab None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:21.559077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0350872-2ec1-416f-a939-c50a749700ab None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:21.580843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:21.592290 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380741d-0360-4952-8f80-f4fb1ea84e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:21.592881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380741d-0360-4952-8f80-f4fb1ea84e7f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:21.593200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380741d-0360-4952-8f80-f4fb1ea84e7f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:21.593493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380741d-0360-4952-8f80-f4fb1ea84e7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:21.594200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380741d-0360-4952-8f80-f4fb1ea84e7f None admin] RBAC: Adding query filter params (group.id=dce7a1dd2eb0438fac4c478b60c2a991, role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=98ff4b51ad344f35909bb4fdee93bcd4) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:21.594499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380741d-0360-4952-8f80-f4fb1ea84e7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:21.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380741d-0360-4952-8f80-f4fb1ea84e7f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:21.601685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 231/455] 10.222.0.77 () {56 vars in 1376 bytes} [Wed Aug 10 22:41:21 2022] GET /identity/v3/role_assignments?group.id=dce7a1dd2eb0438fac4c478b60c2a991&scope.project.id=98ff4b51ad344f35909bb4fdee93bcd4&role.id=edba0d8c079245a38a321d2d77d25419 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:23.990914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e164bfa-c3c6-4a75-88b8-dafcb8cfc843 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:23.991426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e164bfa-c3c6-4a75-88b8-dafcb8cfc843 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:23.991524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e164bfa-c3c6-4a75-88b8-dafcb8cfc843 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:23.993258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 225/456] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:23.998856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14bf8-97bb-4305-bdf9-a11475a70764 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:23.999679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14bf8-97bb-4305-bdf9-a11475a70764 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:24.000171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14bf8-97bb-4305-bdf9-a11475a70764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:24.026361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-25d14bf8-97bb-4305-bdf9-a11475a70764 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:24.027907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-25d14bf8-97bb-4305-bdf9-a11475a70764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:24.110980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 232/457] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:24.148732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e164bfa-c3c6-4a75-88b8-dafcb8cfc843 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:24.182113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:24.189166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62396-e724-4ab2-b4d6-4558dd939e4e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:24.189702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62396-e724-4ab2-b4d6-4558dd939e4e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:24.190176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb62396-e724-4ab2-b4d6-4558dd939e4e None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:24.191961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 233/458] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:24.196888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5c433-d68b-4008-aa67-4a1b94e55d22 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:24.197478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5c433-d68b-4008-aa67-4a1b94e55d22 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:24.197914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5c433-d68b-4008-aa67-4a1b94e55d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:24.230520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-99e5c433-d68b-4008-aa67-4a1b94e55d22 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:24.231687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-99e5c433-d68b-4008-aa67-4a1b94e55d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:24.296589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e164bfa-c3c6-4a75-88b8-dafcb8cfc843 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:24.364803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 234/459] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:41:24.378202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddb850-a8f1-428f-bd5a-1a4274dba6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:24.378836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb850-a8f1-428f-bd5a-1a4274dba6ba None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:24.379105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb850-a8f1-428f-bd5a-1a4274dba6ba None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:24.379431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb850-a8f1-428f-bd5a-1a4274dba6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:24.397164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddb850-a8f1-428f-bd5a-1a4274dba6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:24.398659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddb850-a8f1-428f-bd5a-1a4274dba6ba None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:24.404669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cea7c-d189-4bd1-ac83-b25ff0ee09ad None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:24.404947 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cea7c-d189-4bd1-ac83-b25ff0ee09ad None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:24.405215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cea7c-d189-4bd1-ac83-b25ff0ee09ad None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:24.406565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 235/460] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:41:24.416571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cea7c-d189-4bd1-ac83-b25ff0ee09ad None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-0eddb850-a8f1-428f-bd5a-1a4274dba6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:24.426172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:24.427147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:24.427994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:24.427994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:24.427994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:24.427994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 226/461] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:24.428760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ef14-4fe4-40e5-9841-bea697feb0b8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:24.432373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ef14-4fe4-40e5-9841-bea697feb0b8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:24.432373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ef14-4fe4-40e5-9841-bea697feb0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:24.450091 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-36b5ef14-4fe4-40e5-9841-bea697feb0b8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:24.451382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-36b5ef14-4fe4-40e5-9841-bea697feb0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:24.485753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:24.522048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 227/462] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:24.527661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5ef14-4fe4-40e5-9841-bea697feb0b8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:24.534793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:24.572571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3cea7c-d189-4bd1-ac83-b25ff0ee09ad None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:24.616539 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91518be6-ca9c-4aa3-a45d-fa14e153c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:24.617688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518be6-ca9c-4aa3-a45d-fa14e153c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:24.617969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518be6-ca9c-4aa3-a45d-fa14e153c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:24.618241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518be6-ca9c-4aa3-a45d-fa14e153c9c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:24.631431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91518be6-ca9c-4aa3-a45d-fa14e153c9c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:24.633534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91518be6-ca9c-4aa3-a45d-fa14e153c9c6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-91518be6-ca9c-4aa3-a45d-fa14e153c9c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:24.652608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:24.653624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:24.654462 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:24.654462 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:24.654462 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:24.654462 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 236/463] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:24.655127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91518be6-ca9c-4aa3-a45d-fa14e153c9c6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:24.660302 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5ef14-4fe4-40e5-9841-bea697feb0b8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:24.705203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a25d97-a85c-4e92-89ac-e8baeb6cd93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:24.706629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a25d97-a85c-4e92-89ac-e8baeb6cd93f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:24.707098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a25d97-a85c-4e92-89ac-e8baeb6cd93f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:24.707951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a25d97-a85c-4e92-89ac-e8baeb6cd93f None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:24.709140 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a25d97-a85c-4e92-89ac-e8baeb6cd93f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:24.709707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a25d97-a85c-4e92-89ac-e8baeb6cd93f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:24.712253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a25d97-a85c-4e92-89ac-e8baeb6cd93f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:24.728836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 228/464] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:24.730250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a25d97-a85c-4e92-89ac-e8baeb6cd93f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:24.773809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:24.778793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91518be6-ca9c-4aa3-a45d-fa14e153c9c6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:24.825501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f1e0e-6dde-4527-98cc-e910c145b444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:24.826217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f1e0e-6dde-4527-98cc-e910c145b444 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:24.826732 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f1e0e-6dde-4527-98cc-e910c145b444 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:24.826980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:24.827085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f1e0e-6dde-4527-98cc-e910c145b444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:24.840651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f1e0e-6dde-4527-98cc-e910c145b444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:24.842800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f1e0e-6dde-4527-98cc-e910c145b444 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f01f1e0e-6dde-4527-98cc-e910c145b444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:24.862079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:24.863098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:24.864154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:24.864154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:24.864154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:24.864154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 237/465] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:24.865563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f1e0e-6dde-4527-98cc-e910c145b444 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:24.867150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a25d97-a85c-4e92-89ac-e8baeb6cd93f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:24.913652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15640938-742e-499f-b9fd-9dfd5fbfe4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:24.914268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640938-742e-499f-b9fd-9dfd5fbfe4ec None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:24.914548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640938-742e-499f-b9fd-9dfd5fbfe4ec None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:24.914820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640938-742e-499f-b9fd-9dfd5fbfe4ec None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:24.915465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15640938-742e-499f-b9fd-9dfd5fbfe4ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:24.915766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15640938-742e-499f-b9fd-9dfd5fbfe4ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:24.917136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15640938-742e-499f-b9fd-9dfd5fbfe4ec None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:24.937952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 229/466] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:24.937952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15640938-742e-499f-b9fd-9dfd5fbfe4ec None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:24.994045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f1e0e-6dde-4527-98cc-e910c145b444 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:25.029190 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065090c-f6a8-4928-99b1-0acbeeb386f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:25.029827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065090c-f6a8-4928-99b1-0acbeeb386f1 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:25.030144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065090c-f6a8-4928-99b1-0acbeeb386f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:25.030435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065090c-f6a8-4928-99b1-0acbeeb386f1 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:25.030957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065090c-f6a8-4928-99b1-0acbeeb386f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:25.032596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065090c-f6a8-4928-99b1-0acbeeb386f1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:25.048722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15640938-742e-499f-b9fd-9dfd5fbfe4ec None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:25.074406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:25.083211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7fb6c-9703-4dee-aeb5-36307d668c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:25.083753 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7fb6c-9703-4dee-aeb5-36307d668c7a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:25.084028 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7fb6c-9703-4dee-aeb5-36307d668c7a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:25.084295 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7fb6c-9703-4dee-aeb5-36307d668c7a None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:25.084929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7fb6c-9703-4dee-aeb5-36307d668c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:25.085225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7fb6c-9703-4dee-aeb5-36307d668c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:25.086597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7fb6c-9703-4dee-aeb5-36307d668c7a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:25.097789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 230/467] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:25.098653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7fb6c-9703-4dee-aeb5-36307d668c7a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:25.154133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 238/468] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:41:24 2022] POST /identity/v3/users => generated 246 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:41:25.155375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedbba6-3bac-471a-9b24-199a843d89b7 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:25.155657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedbba6-3bac-471a-9b24-199a843d89b7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:25.155930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedbba6-3bac-471a-9b24-199a843d89b7 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:25.157318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 239/469] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:25.163018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedbba6-3bac-471a-9b24-199a843d89b7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:25.173630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:25.227225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7fb6c-9703-4dee-aeb5-36307d668c7a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:25.283324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e636326-ea18-4f01-9b4b-3ab2ff5572b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:25.284636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e636326-ea18-4f01-9b4b-3ab2ff5572b8 None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:25.285139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e636326-ea18-4f01-9b4b-3ab2ff5572b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:25.285646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e636326-ea18-4f01-9b4b-3ab2ff5572b8 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:25.287183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e636326-ea18-4f01-9b4b-3ab2ff5572b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:25.287777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedbba6-3bac-471a-9b24-199a843d89b7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:25.288966 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e636326-ea18-4f01-9b4b-3ab2ff5572b8 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:25.327306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7c7f2-99d9-4d3c-9c5f-ea58147835d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:25.327306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c7f2-99d9-4d3c-9c5f-ea58147835d3 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:25.327306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c7f2-99d9-4d3c-9c5f-ea58147835d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:25.327306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c7f2-99d9-4d3c-9c5f-ea58147835d3 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:25.329222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7c7f2-99d9-4d3c-9c5f-ea58147835d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:25.331053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7c7f2-99d9-4d3c-9c5f-ea58147835d3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:25.464165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 240/470] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:41:25 2022] POST /identity/v3/users => generated 248 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:41:25.465154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8997cd-737a-4c1a-8359-9d5276196b05 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:25.465481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8997cd-737a-4c1a-8359-9d5276196b05 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:25.465755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8997cd-737a-4c1a-8359-9d5276196b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:25.498413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2b8997cd-737a-4c1a-8359-9d5276196b05 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:25.499632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2b8997cd-737a-4c1a-8359-9d5276196b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:25.518168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 231/471] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:41:25 2022] POST /identity/v3/users => generated 248 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:41:25.581672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:25.595186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 241/472] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:25.620782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e636326-ea18-4f01-9b4b-3ab2ff5572b8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:25.676826 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:25.762177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e636326-ea18-4f01-9b4b-3ab2ff5572b8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:25.768433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b85d78-5d71-4717-bb33-b15b19b7e7c7 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:25.768748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b85d78-5d71-4717-bb33-b15b19b7e7c7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:25.771863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b85d78-5d71-4717-bb33-b15b19b7e7c7 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:25.771863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 242/473] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:25.777476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fb029-3a2d-40a4-bc75-51826c5ec21b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:25.777757 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fb029-3a2d-40a4-bc75-51826c5ec21b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:25.778031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fb029-3a2d-40a4-bc75-51826c5ec21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:25.812294 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-391fb029-3a2d-40a4-bc75-51826c5ec21b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:25.813900 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-391fb029-3a2d-40a4-bc75-51826c5ec21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:25.815567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1781b-97f7-4500-a584-7a9574045d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:25.816396 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1781b-97f7-4500-a584-7a9574045d6b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:25.816839 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1781b-97f7-4500-a584-7a9574045d6b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:25.817245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1781b-97f7-4500-a584-7a9574045d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:25.833217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1781b-97f7-4500-a584-7a9574045d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:25.835725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1781b-97f7-4500-a584-7a9574045d6b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-a6d1781b-97f7-4500-a584-7a9574045d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:25.856862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:25.857980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:25.858887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:25.858887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:25.858887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:25.858887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 232/474] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:25.866297 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1781b-97f7-4500-a584-7a9574045d6b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:25.913436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 243/475] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:25.933670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fb029-3a2d-40a4-bc75-51826c5ec21b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:25.972535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:25.980255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1781b-97f7-4500-a584-7a9574045d6b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:26.020489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76025b8f-2705-4bc4-bd40-287949789340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:26.021710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025b8f-2705-4bc4-bd40-287949789340 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:26.022111 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025b8f-2705-4bc4-bd40-287949789340 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:26.022458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025b8f-2705-4bc4-bd40-287949789340 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:26.023202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76025b8f-2705-4bc4-bd40-287949789340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:26.023573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76025b8f-2705-4bc4-bd40-287949789340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:26.025151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76025b8f-2705-4bc4-bd40-287949789340 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:26.042988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 233/476] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:26.049813 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fb029-3a2d-40a4-bc75-51826c5ec21b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:26.050334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76025b8f-2705-4bc4-bd40-287949789340 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:26.104179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:26.128642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b673f-c756-4387-9047-ada75d74c1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:26.129262 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b673f-c756-4387-9047-ada75d74c1b9 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:26.129564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b673f-c756-4387-9047-ada75d74c1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:26.129836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b673f-c756-4387-9047-ada75d74c1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:26.131169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b673f-c756-4387-9047-ada75d74c1b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:26.132625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b673f-c756-4387-9047-ada75d74c1b9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:26.177660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.sql.core [None req-769b673f-c756-4387-9047-ada75d74c1b9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 22:41:26.177660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 22:41:26.177660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [parameters: {'id': 'fc8ea71b379d4e52b61391dfe26adf9b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 22:41:26.177660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-769b673f-c756-4387-9047-ada75d74c1b9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application conn.query(q) Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result.read() Aug 10 22:41:26.197579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return ref.to_dict() Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 22:41:26.198489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application next(self.gen) Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application yield resource Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application next(self.gen) Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise self.value Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application session.commit() Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 22:41:26.199889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.session.flush() Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application compat.raise_( Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 22:41:26.200976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 22:41:26.202088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application conn.query(q) Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result.read() Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 22:41:26.203078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [parameters: {'id': 'fc8ea71b379d4e52b61391dfe26adf9b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:26.204093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 22:41:26.205191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:26.206066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 244/477] 10.222.0.77 () {60 vars in 1131 bytes} [Wed Aug 10 22:41:25 2022] POST /identity/v3/roles => generated 144 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:26.214460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b673f-c756-4387-9047-ada75d74c1b9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:26.222206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76025b8f-2705-4bc4-bd40-287949789340 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:26.272553 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a773f9-35c7-4382-ac30-8b380a566507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:26.273078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a773f9-35c7-4382-ac30-8b380a566507 None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:26.273498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a773f9-35c7-4382-ac30-8b380a566507 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:26.273662 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a773f9-35c7-4382-ac30-8b380a566507 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:26.274304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a773f9-35c7-4382-ac30-8b380a566507 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:26.275724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a773f9-35c7-4382-ac30-8b380a566507 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:26.361921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b673f-c756-4387-9047-ada75d74c1b9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:26.377530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 234/478] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:41:26 2022] POST /identity/v3/users => generated 249 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:41:26.407234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7ca17-d97e-438b-a41b-61e5d3e0c385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:26.407875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ca17-d97e-438b-a41b-61e5d3e0c385 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:26.408151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ca17-d97e-438b-a41b-61e5d3e0c385 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:26.408421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ca17-d97e-438b-a41b-61e5d3e0c385 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:26.420819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7ca17-d97e-438b-a41b-61e5d3e0c385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-dee7ca17-d97e-438b-a41b-61e5d3e0c385 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:26.425841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:26.426822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:26.428857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 245/479] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:41:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:26.435037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a773f9-35c7-4382-ac30-8b380a566507 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:26.468894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:26.598062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a773f9-35c7-4382-ac30-8b380a566507 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:26.634445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b59d0a-c1b3-40b5-ac4a-67fbd18f57d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:26.635431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59d0a-c1b3-40b5-ac4a-67fbd18f57d0 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:26.635905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59d0a-c1b3-40b5-ac4a-67fbd18f57d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:26.636395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59d0a-c1b3-40b5-ac4a-67fbd18f57d0 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:26.637255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b59d0a-c1b3-40b5-ac4a-67fbd18f57d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:26.637777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b59d0a-c1b3-40b5-ac4a-67fbd18f57d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:26.639327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b59d0a-c1b3-40b5-ac4a-67fbd18f57d0 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:26.648359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 235/480] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:27.482395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873acd-ceb3-4332-9528-3d78f8b218b2 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:27.482912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873acd-ceb3-4332-9528-3d78f8b218b2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:27.482912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873acd-ceb3-4332-9528-3d78f8b218b2 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:27.484482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 246/481] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:27.489982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42621e8-d7c2-4a8f-92dc-86a692d07ea2 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:27.490812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42621e8-d7c2-4a8f-92dc-86a692d07ea2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:27.491282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42621e8-d7c2-4a8f-92dc-86a692d07ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:27.516815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e42621e8-d7c2-4a8f-92dc-86a692d07ea2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:27.518401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e42621e8-d7c2-4a8f-92dc-86a692d07ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:27.617155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 236/482] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:27.651646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81873acd-ceb3-4332-9528-3d78f8b218b2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:27.725857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:27.806186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81873acd-ceb3-4332-9528-3d78f8b218b2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:27.853792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc64ac6-4f61-40bf-bf13-6bd38c88bd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:27.854812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64ac6-4f61-40bf-bf13-6bd38c88bd11 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:27.855309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64ac6-4f61-40bf-bf13-6bd38c88bd11 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:27.855735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64ac6-4f61-40bf-bf13-6bd38c88bd11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:27.876615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc64ac6-4f61-40bf-bf13-6bd38c88bd11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-dcc64ac6-4f61-40bf-bf13-6bd38c88bd11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:27.886360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:27.887250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:27.888031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 247/483] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:27.898401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42621e8-d7c2-4a8f-92dc-86a692d07ea2 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:27.901584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:28.053901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42621e8-d7c2-4a8f-92dc-86a692d07ea2 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:28.104063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e034-dcf7-4b51-9ca0-b6d08328f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:28.104586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e034-dcf7-4b51-9ca0-b6d08328f224 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.104857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e034-dcf7-4b51-9ca0-b6d08328f224 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.105121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e034-dcf7-4b51-9ca0-b6d08328f224 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.105808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e034-dcf7-4b51-9ca0-b6d08328f224 None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:28.106102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e034-dcf7-4b51-9ca0-b6d08328f224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:28.107443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e034-dcf7-4b51-9ca0-b6d08328f224 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:28.119633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 237/484] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:28.125158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc64ac6-4f61-40bf-bf13-6bd38c88bd11 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:28.189748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff520-2357-4481-9b0e-704634026406 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.190063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff520-2357-4481-9b0e-704634026406 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.192919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff520-2357-4481-9b0e-704634026406 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.192919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 238/485] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:41:28.197246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9f0de-a397-4b84-8ef6-d1ecda5a7eea None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.197552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9f0de-a397-4b84-8ef6-d1ecda5a7eea None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.197817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9f0de-a397-4b84-8ef6-d1ecda5a7eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.216655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b1c9f0de-a397-4b84-8ef6-d1ecda5a7eea None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:28.217872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b1c9f0de-a397-4b84-8ef6-d1ecda5a7eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:28.278290 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc64ac6-4f61-40bf-bf13-6bd38c88bd11 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:28.284014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:28.287093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:28.295205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 239/486] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:28.311692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b33b7-c873-4abb-a854-a6003e18c524 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.311692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b33b7-c873-4abb-a854-a6003e18c524 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.311692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b33b7-c873-4abb-a854-a6003e18c524 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.311692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 240/487] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:28.313523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd672584-75c5-4b63-9354-3f68f45f759d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.313810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd672584-75c5-4b63-9354-3f68f45f759d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.314082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd672584-75c5-4b63-9354-3f68f45f759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.329549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221765ee-6076-47c3-92bd-d851ddf3754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:28.330085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221765ee-6076-47c3-92bd-d851ddf3754d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.330361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221765ee-6076-47c3-92bd-d851ddf3754d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.330633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221765ee-6076-47c3-92bd-d851ddf3754d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.332596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-bd672584-75c5-4b63-9354-3f68f45f759d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:28.333851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bd672584-75c5-4b63-9354-3f68f45f759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:28.343157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221765ee-6076-47c3-92bd-d851ddf3754d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:28.344628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221765ee-6076-47c3-92bd-d851ddf3754d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-221765ee-6076-47c3-92bd-d851ddf3754d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:28.359713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:28.360589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:28.361453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:28.361453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:28.361453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:28.361453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 248/488] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:28.362065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221765ee-6076-47c3-92bd-d851ddf3754d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:28.404823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 241/489] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:28.405715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd672584-75c5-4b63-9354-3f68f45f759d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:28.493630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221765ee-6076-47c3-92bd-d851ddf3754d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:28.514361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd672584-75c5-4b63-9354-3f68f45f759d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:28.529826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dfa0d-4e16-47dc-a03d-0e5e5aae3433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:28.530556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dfa0d-4e16-47dc-a03d-0e5e5aae3433 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.530836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dfa0d-4e16-47dc-a03d-0e5e5aae3433 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.531106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dfa0d-4e16-47dc-a03d-0e5e5aae3433 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.541149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:28.543933 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dfa0d-4e16-47dc-a03d-0e5e5aae3433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-065dfa0d-4e16-47dc-a03d-0e5e5aae3433 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:28.549486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:28.558825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 249/490] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:28.560171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dfa0d-4e16-47dc-a03d-0e5e5aae3433 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:28.560863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ce389-19c9-4749-be34-d9de56ea90a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:28.560863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce389-19c9-4749-be34-d9de56ea90a2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.560863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce389-19c9-4749-be34-d9de56ea90a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.560863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce389-19c9-4749-be34-d9de56ea90a2 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.561108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ce389-19c9-4749-be34-d9de56ea90a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:28.561108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ce389-19c9-4749-be34-d9de56ea90a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:28.562498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ce389-19c9-4749-be34-d9de56ea90a2 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:28.576000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:28.576309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 242/491] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:28.577792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ce389-19c9-4749-be34-d9de56ea90a2 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:28.661135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dfa0d-4e16-47dc-a03d-0e5e5aae3433 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:28.687068 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ce389-19c9-4749-be34-d9de56ea90a2 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:28.696720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ed25c-87df-45d7-bdfd-57ae4d75aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:28.697696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ed25c-87df-45d7-bdfd-57ae4d75aa94 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.698173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ed25c-87df-45d7-bdfd-57ae4d75aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.698661 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ed25c-87df-45d7-bdfd-57ae4d75aa94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.710171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ed25c-87df-45d7-bdfd-57ae4d75aa94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-de1ed25c-87df-45d7-bdfd-57ae4d75aa94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:28.715635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:28.716511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:28.717321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:28.719553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 250/492] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:28.720596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ed25c-87df-45d7-bdfd-57ae4d75aa94 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:28.725872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b33e1-e707-4331-8dbf-7bf700fc0bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:28.726047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b33e1-e707-4331-8dbf-7bf700fc0bd2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.726259 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b33e1-e707-4331-8dbf-7bf700fc0bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.726532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b33e1-e707-4331-8dbf-7bf700fc0bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.727191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b33e1-e707-4331-8dbf-7bf700fc0bd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:28.727485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b33e1-e707-4331-8dbf-7bf700fc0bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:28.728844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b33e1-e707-4331-8dbf-7bf700fc0bd2 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:28.738474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 243/493] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:28.739337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b33e1-e707-4331-8dbf-7bf700fc0bd2 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:28.790734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:28.806056 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:28.836446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ed25c-87df-45d7-bdfd-57ae4d75aa94 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:28.861931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b33e1-e707-4331-8dbf-7bf700fc0bd2 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:28.884627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a4676-f90b-4c18-84f0-019b69e2f869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:28.885570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a4676-f90b-4c18-84f0-019b69e2f869 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.886020 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a4676-f90b-4c18-84f0-019b69e2f869 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.887084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a4676-f90b-4c18-84f0-019b69e2f869 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.898534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a4676-f90b-4c18-84f0-019b69e2f869 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:28.900787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a4676-f90b-4c18-84f0-019b69e2f869 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:28.906376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f061254-6011-4a95-8fb9-0243b33f686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:28.907129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f061254-6011-4a95-8fb9-0243b33f686b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:28.907469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f061254-6011-4a95-8fb9-0243b33f686b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:28.907829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f061254-6011-4a95-8fb9-0243b33f686b None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:28.908763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f061254-6011-4a95-8fb9-0243b33f686b None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:28.909321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f061254-6011-4a95-8fb9-0243b33f686b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:28.910982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f061254-6011-4a95-8fb9-0243b33f686b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-305a4676-f90b-4c18-84f0-019b69e2f869 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:28.918531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:28.919405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:28.920265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:28.920265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:28.920265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:28.920265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:28.920265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:28.920265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:28.920265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:28.920265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:28.920265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:41:28.920265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:28.920955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 244/494] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:28.921938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f061254-6011-4a95-8fb9-0243b33f686b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:28.922627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 251/495] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Aug 10 22:41:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:28.926951 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a4676-f90b-4c18-84f0-019b69e2f869 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:29.050747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f061254-6011-4a95-8fb9-0243b33f686b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:29.058808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a4676-f90b-4c18-84f0-019b69e2f869 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:29.062189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:29.094117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98987deb-ee87-4875-b15b-6aae4d7dbfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:29.095142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987deb-ee87-4875-b15b-6aae4d7dbfa0 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.095724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987deb-ee87-4875-b15b-6aae4d7dbfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.096010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98987deb-ee87-4875-b15b-6aae4d7dbfa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.103402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f7ad3-c109-4c62-8284-c476c93ccae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:29.104022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7ad3-c109-4c62-8284-c476c93ccae6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.104666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7ad3-c109-4c62-8284-c476c93ccae6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.104666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7ad3-c109-4c62-8284-c476c93ccae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.109116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98987deb-ee87-4875-b15b-6aae4d7dbfa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:29.110594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98987deb-ee87-4875-b15b-6aae4d7dbfa0 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:29.113491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:29.118212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f7ad3-c109-4c62-8284-c476c93ccae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:29.120015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f7ad3-c109-4c62-8284-c476c93ccae6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-98987deb-ee87-4875-b15b-6aae4d7dbfa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:29.125036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:29.126711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:29.127819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:29.127819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:29.127819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:29.127819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 245/496] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:29.129560 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98987deb-ee87-4875-b15b-6aae4d7dbfa0 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-0b3f7ad3-c109-4c62-8284-c476c93ccae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:29.137439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:29.138538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:29.139430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:29.139430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:29.139430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:29.141933 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 252/497] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:29.143181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a9aa-2c95-43bc-95e6-7afc8e8801e3 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.143519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a9aa-2c95-43bc-95e6-7afc8e8801e3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.143789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a9aa-2c95-43bc-95e6-7afc8e8801e3 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.145167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 253/498] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:29.148569 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49a9aa-2c95-43bc-95e6-7afc8e8801e3 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:29.238443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98987deb-ee87-4875-b15b-6aae4d7dbfa0 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:29.254139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49a9aa-2c95-43bc-95e6-7afc8e8801e3 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:29.272074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9298a91-6d12-4b49-8d49-4cd95aa6fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:29.272662 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9298a91-6d12-4b49-8d49-4cd95aa6fade None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.272933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9298a91-6d12-4b49-8d49-4cd95aa6fade None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.273197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9298a91-6d12-4b49-8d49-4cd95aa6fade None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.273947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9298a91-6d12-4b49-8d49-4cd95aa6fade None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:29.274243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9298a91-6d12-4b49-8d49-4cd95aa6fade None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:29.275655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9298a91-6d12-4b49-8d49-4cd95aa6fade None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:29.286856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a25a4a-4676-49cb-b1ae-05dd9b99ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:29.287447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25a4a-4676-49cb-b1ae-05dd9b99ede4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.287717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25a4a-4676-49cb-b1ae-05dd9b99ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.287988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a25a4a-4676-49cb-b1ae-05dd9b99ede4 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.288619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a25a4a-4676-49cb-b1ae-05dd9b99ede4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:29.288913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a25a4a-4676-49cb-b1ae-05dd9b99ede4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:29.290297 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a25a4a-4676-49cb-b1ae-05dd9b99ede4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:29.301771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 254/499] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:29.303086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a25a4a-4676-49cb-b1ae-05dd9b99ede4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:29.311309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 246/500] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Aug 10 22:41:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:29.312527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d476bf-b9b2-47b2-8a50-a6c671d8d85a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.316448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d476bf-b9b2-47b2-8a50-a6c671d8d85a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.316448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d476bf-b9b2-47b2-8a50-a6c671d8d85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.331078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-86d476bf-b9b2-47b2-8a50-a6c671d8d85a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:29.332264 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-86d476bf-b9b2-47b2-8a50-a6c671d8d85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:29.345463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:29.354214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:29.397951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 247/501] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:29.399407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2782a-b68c-4d68-9261-e8f6b1cf1bc4 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.399683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2782a-b68c-4d68-9261-e8f6b1cf1bc4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.399947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2782a-b68c-4d68-9261-e8f6b1cf1bc4 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.401149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 248/502] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:29.401858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2782a-b68c-4d68-9261-e8f6b1cf1bc4 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:29.407895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a25a4a-4676-49cb-b1ae-05dd9b99ede4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:29.442154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9bffe-a486-44fe-b79b-287041a8984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:29.443383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9bffe-a486-44fe-b79b-287041a8984f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.443658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9bffe-a486-44fe-b79b-287041a8984f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.443923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9bffe-a486-44fe-b79b-287041a8984f None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.444558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9bffe-a486-44fe-b79b-287041a8984f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:29.444853 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9bffe-a486-44fe-b79b-287041a8984f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:29.446248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9bffe-a486-44fe-b79b-287041a8984f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:29.458906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 255/503] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:29.459709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9bffe-a486-44fe-b79b-287041a8984f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:29.504440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2782a-b68c-4d68-9261-e8f6b1cf1bc4 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:29.538207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c11b0-267d-4d24-9431-c39f0bb9d563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:29.538882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c11b0-267d-4d24-9431-c39f0bb9d563 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.539080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c11b0-267d-4d24-9431-c39f0bb9d563 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.539343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c11b0-267d-4d24-9431-c39f0bb9d563 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.547503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c11b0-267d-4d24-9431-c39f0bb9d563 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:29.548469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c11b0-267d-4d24-9431-c39f0bb9d563 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:29.559986 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9bffe-a486-44fe-b79b-287041a8984f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-8b1c11b0-267d-4d24-9431-c39f0bb9d563 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:29.562471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:29.563545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:29.564649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:29.564649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:29.564649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:29.564649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:29.564649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:29.564649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:29.564649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:29.564649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:29.564649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 22:41:29.564649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:29.568263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 249/504] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:29.569400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1e973-82a5-45e8-8c7a-4faff8c2cf22 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.569679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1e973-82a5-45e8-8c7a-4faff8c2cf22 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.569946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1e973-82a5-45e8-8c7a-4faff8c2cf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.573146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:29.587298 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-90e1e973-82a5-45e8-8c7a-4faff8c2cf22 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:29.588503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-90e1e973-82a5-45e8-8c7a-4faff8c2cf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:29.590524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:29.595840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4384e-8540-4e17-be73-7351314b2347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:29.596444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4384e-8540-4e17-be73-7351314b2347 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.596714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4384e-8540-4e17-be73-7351314b2347 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.597022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4384e-8540-4e17-be73-7351314b2347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.657260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 250/505] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:29.669519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1e973-82a5-45e8-8c7a-4faff8c2cf22 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:29.669603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4384e-8540-4e17-be73-7351314b2347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:29.677529 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4384e-8540-4e17-be73-7351314b2347 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:29.763137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1e973-82a5-45e8-8c7a-4faff8c2cf22 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:29.769210 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 256/506] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:29.770076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4384e-8540-4e17-be73-7351314b2347 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:29.781400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:29.807322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3e762-6797-44ed-854d-a0ad3b93e8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:29.807944 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3e762-6797-44ed-854d-a0ad3b93e8b4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.808222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3e762-6797-44ed-854d-a0ad3b93e8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.808489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3e762-6797-44ed-854d-a0ad3b93e8b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.815295 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:29.819908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3e762-6797-44ed-854d-a0ad3b93e8b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:29.821388 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3e762-6797-44ed-854d-a0ad3b93e8b4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-c9a3e762-6797-44ed-854d-a0ad3b93e8b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:29.835416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:29.836451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:29.837633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:29.837633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:29.837633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:29.837633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 251/507] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:29.837633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3e762-6797-44ed-854d-a0ad3b93e8b4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:29.874762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4384e-8540-4e17-be73-7351314b2347 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:29.911297 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5082-aaa1-4361-9a9e-d20aa5d9973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:29.912401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5082-aaa1-4361-9a9e-d20aa5d9973e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.912672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5082-aaa1-4361-9a9e-d20aa5d9973e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.912940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c5082-aaa1-4361-9a9e-d20aa5d9973e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.919952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c5082-aaa1-4361-9a9e-d20aa5d9973e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:29.921406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c5082-aaa1-4361-9a9e-d20aa5d9973e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-092c5082-aaa1-4361-9a9e-d20aa5d9973e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:29.932594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:29.933542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 257/508] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:29.934431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5082-aaa1-4361-9a9e-d20aa5d9973e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:29.950162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3e762-6797-44ed-854d-a0ad3b93e8b4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:29.984010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1d374-7d71-4491-9879-5966a2154343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:29.984608 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1d374-7d71-4491-9879-5966a2154343 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:29.984882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1d374-7d71-4491-9879-5966a2154343 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:29.985153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1d374-7d71-4491-9879-5966a2154343 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:29.985902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1d374-7d71-4491-9879-5966a2154343 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:29.986262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1d374-7d71-4491-9879-5966a2154343 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:29.987678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1d374-7d71-4491-9879-5966a2154343 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:30.004643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 252/509] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Aug 10 22:41:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:30.004783 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:30.005485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1d374-7d71-4491-9879-5966a2154343 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:30.035576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c5082-aaa1-4361-9a9e-d20aa5d9973e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:30.054341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:30.068973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523dfd-7804-4dfe-92d9-95f8389be776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:30.069650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523dfd-7804-4dfe-92d9-95f8389be776 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:30.069931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523dfd-7804-4dfe-92d9-95f8389be776 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:30.070207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80523dfd-7804-4dfe-92d9-95f8389be776 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:30.080159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80523dfd-7804-4dfe-92d9-95f8389be776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-80523dfd-7804-4dfe-92d9-95f8389be776 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:30.085885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:30.086785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:30.087577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 258/510] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:30.088248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523dfd-7804-4dfe-92d9-95f8389be776 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:30.110894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1d374-7d71-4491-9879-5966a2154343 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:30.150371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69757763-5812-4e05-abe0-d8fbdd9f862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:30.151251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69757763-5812-4e05-abe0-d8fbdd9f862d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:30.151665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69757763-5812-4e05-abe0-d8fbdd9f862d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:30.152063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69757763-5812-4e05-abe0-d8fbdd9f862d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:30.163179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69757763-5812-4e05-abe0-d8fbdd9f862d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:30.164606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69757763-5812-4e05-abe0-d8fbdd9f862d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-69757763-5812-4e05-abe0-d8fbdd9f862d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:30.178840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:30.179771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:30.180607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:30.180607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:30.180607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:30.180607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 253/511] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:30.180840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69757763-5812-4e05-abe0-d8fbdd9f862d None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:30.190428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80523dfd-7804-4dfe-92d9-95f8389be776 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:30.218767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:30.225244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed999ff-5077-4d5f-92bb-53cbb4502199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:30.225859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed999ff-5077-4d5f-92bb-53cbb4502199 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:30.226128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed999ff-5077-4d5f-92bb-53cbb4502199 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:30.226444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed999ff-5077-4d5f-92bb-53cbb4502199 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:30.227077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed999ff-5077-4d5f-92bb-53cbb4502199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:30.227367 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed999ff-5077-4d5f-92bb-53cbb4502199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:30.228726 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed999ff-5077-4d5f-92bb-53cbb4502199 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:30.240613 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 259/512] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:30.241239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed999ff-5077-4d5f-92bb-53cbb4502199 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:30.282629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:30.286172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69757763-5812-4e05-abe0-d8fbdd9f862d None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:30.320607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ce24f-b401-4979-8b16-bc4d6d309ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:30.321207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ce24f-b401-4979-8b16-bc4d6d309ffc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:30.321510 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ce24f-b401-4979-8b16-bc4d6d309ffc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:30.321809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ce24f-b401-4979-8b16-bc4d6d309ffc None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:30.322529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ce24f-b401-4979-8b16-bc4d6d309ffc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:30.322829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ce24f-b401-4979-8b16-bc4d6d309ffc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:30.324287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ce24f-b401-4979-8b16-bc4d6d309ffc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:30.339035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed999ff-5077-4d5f-92bb-53cbb4502199 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:30.341771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 254/513] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Aug 10 22:41:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:30.342575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ce24f-b401-4979-8b16-bc4d6d309ffc None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:30.431348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a77cca-fae8-48b1-90eb-24f00ae3894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:30.431942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a77cca-fae8-48b1-90eb-24f00ae3894a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:30.432511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a77cca-fae8-48b1-90eb-24f00ae3894a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:30.432776 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a77cca-fae8-48b1-90eb-24f00ae3894a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:30.445061 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ce24f-b401-4979-8b16-bc4d6d309ffc None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:30.479332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142b272-400c-4803-b585-78b1f560331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:30.479923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142b272-400c-4803-b585-78b1f560331d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:30.480192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142b272-400c-4803-b585-78b1f560331d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:30.480462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142b272-400c-4803-b585-78b1f560331d None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:30.481106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142b272-400c-4803-b585-78b1f560331d None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:30.481429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142b272-400c-4803-b585-78b1f560331d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:30.482787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142b272-400c-4803-b585-78b1f560331d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:30.488552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:30.491163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 255/514] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:30.491944 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142b272-400c-4803-b585-78b1f560331d None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:30.500138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a77cca-fae8-48b1-90eb-24f00ae3894a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:30.503570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a77cca-fae8-48b1-90eb-24f00ae3894a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:30.516374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:30.596870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142b272-400c-4803-b585-78b1f560331d None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:30.600526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 260/515] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:30.601360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a77cca-fae8-48b1-90eb-24f00ae3894a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:30.632493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b94c7-22d6-472d-add7-db3ad9669453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:30.633086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b94c7-22d6-472d-add7-db3ad9669453 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:30.633376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b94c7-22d6-472d-add7-db3ad9669453 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:30.633637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b94c7-22d6-472d-add7-db3ad9669453 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:30.634266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b94c7-22d6-472d-add7-db3ad9669453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:30.634558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b94c7-22d6-472d-add7-db3ad9669453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:30.635914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b94c7-22d6-472d-add7-db3ad9669453 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:30.647834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 256/516] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:30.648641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b94c7-22d6-472d-add7-db3ad9669453 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:30.692518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:30.702015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a77cca-fae8-48b1-90eb-24f00ae3894a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:30.737713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143eb04-8f8e-4a45-955d-9e3378bbf2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:30.738303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143eb04-8f8e-4a45-955d-9e3378bbf2d2 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:30.738573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143eb04-8f8e-4a45-955d-9e3378bbf2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:30.738841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143eb04-8f8e-4a45-955d-9e3378bbf2d2 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:30.739299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:30.739493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143eb04-8f8e-4a45-955d-9e3378bbf2d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:30.740959 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143eb04-8f8e-4a45-955d-9e3378bbf2d2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:30.766322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b94c7-22d6-472d-add7-db3ad9669453 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:30.801219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51399666-1647-4c05-92ca-acda4719eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:30.801856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51399666-1647-4c05-92ca-acda4719eece None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:30.802273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51399666-1647-4c05-92ca-acda4719eece None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:30.802555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51399666-1647-4c05-92ca-acda4719eece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:30.867411 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51399666-1647-4c05-92ca-acda4719eece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:30.868862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51399666-1647-4c05-92ca-acda4719eece None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:30.879554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 261/517] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:41:30 2022] POST /identity/v3/users => generated 247 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:41:30.880412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143eb04-8f8e-4a45-955d-9e3378bbf2d2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:30.963731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:30.987660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 257/518] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:30.988829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51399666-1647-4c05-92ca-acda4719eece None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.009636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143eb04-8f8e-4a45-955d-9e3378bbf2d2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.049637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f12a20-6308-497a-a40d-a7ea8df21205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.050274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f12a20-6308-497a-a40d-a7ea8df21205 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.050548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f12a20-6308-497a-a40d-a7ea8df21205 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.050816 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f12a20-6308-497a-a40d-a7ea8df21205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.062787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f12a20-6308-497a-a40d-a7ea8df21205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.064268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f12a20-6308-497a-a40d-a7ea8df21205 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.072049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f7f12a20-6308-497a-a40d-a7ea8df21205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:31.082488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:31.085077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:31.086106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:31.086106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:31.086106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:31.086106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 262/519] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:31.086106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f12a20-6308-497a-a40d-a7ea8df21205 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.112361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51399666-1647-4c05-92ca-acda4719eece None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.148463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d649a-3a70-4ada-ad17-463e6d15ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.149087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d649a-3a70-4ada-ad17-463e6d15ef6c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.149400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d649a-3a70-4ada-ad17-463e6d15ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.149672 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d649a-3a70-4ada-ad17-463e6d15ef6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.160211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d649a-3a70-4ada-ad17-463e6d15ef6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.161796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d649a-3a70-4ada-ad17-463e6d15ef6c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-0b8d649a-3a70-4ada-ad17-463e6d15ef6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:31.177216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:31.178372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:31.179319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:31.179319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:31.179319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:31.179319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 258/520] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:31.179563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d649a-3a70-4ada-ad17-463e6d15ef6c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.202253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f12a20-6308-497a-a40d-a7ea8df21205 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.215268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:31.242323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8a092-d3d4-4b36-be31-b88f43156e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.242943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a092-d3d4-4b36-be31-b88f43156e98 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.243218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a092-d3d4-4b36-be31-b88f43156e98 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.243484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8a092-d3d4-4b36-be31-b88f43156e98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.250551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8a092-d3d4-4b36-be31-b88f43156e98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.252720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8a092-d3d4-4b36-be31-b88f43156e98 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f5d8a092-d3d4-4b36-be31-b88f43156e98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:31.265917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:31.266855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:31.267817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:31.267817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:31.267817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:31.267817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:31.267817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:31.267817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:31.267817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:31.267817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:31.267817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 263/521] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:31.267817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8a092-d3d4-4b36-be31-b88f43156e98 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.294641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d649a-3a70-4ada-ad17-463e6d15ef6c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.331726 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:31.334963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94df692-00dc-44c2-9186-e173bebc43dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.334963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94df692-00dc-44c2-9186-e173bebc43dd None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.335249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94df692-00dc-44c2-9186-e173bebc43dd None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.335694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94df692-00dc-44c2-9186-e173bebc43dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.348200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94df692-00dc-44c2-9186-e173bebc43dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.349713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94df692-00dc-44c2-9186-e173bebc43dd None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d94df692-00dc-44c2-9186-e173bebc43dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:31.367987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:31.371178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:31.372023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:31.372023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:31.372023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:31.372023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 259/522] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:31.372023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94df692-00dc-44c2-9186-e173bebc43dd None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.387237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8a092-d3d4-4b36-be31-b88f43156e98 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.424712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e302da-16d4-4805-b089-cbc658b6d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.425334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e302da-16d4-4805-b089-cbc658b6d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.425619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e302da-16d4-4805-b089-cbc658b6d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.425894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e302da-16d4-4805-b089-cbc658b6d2b4 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.426541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e302da-16d4-4805-b089-cbc658b6d2b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:31.427353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e302da-16d4-4805-b089-cbc658b6d2b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.428891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e302da-16d4-4805-b089-cbc658b6d2b4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.452330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 264/523] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:31.453363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e302da-16d4-4805-b089-cbc658b6d2b4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.475101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:31.492682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94df692-00dc-44c2-9186-e173bebc43dd None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.529683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65382c-50b0-47a0-9b7c-ffb6696026d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.530288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65382c-50b0-47a0-9b7c-ffb6696026d0 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.530561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65382c-50b0-47a0-9b7c-ffb6696026d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.530830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65382c-50b0-47a0-9b7c-ffb6696026d0 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.531533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65382c-50b0-47a0-9b7c-ffb6696026d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:31.531831 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65382c-50b0-47a0-9b7c-ffb6696026d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.533220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65382c-50b0-47a0-9b7c-ffb6696026d0 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.557518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 260/524] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:31.557518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65382c-50b0-47a0-9b7c-ffb6696026d0 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.575758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e302da-16d4-4805-b089-cbc658b6d2b4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.595693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:31.613601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13ab8c-df86-4e9b-a61e-435b2675de49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.622477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13ab8c-df86-4e9b-a61e-435b2675de49 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.622477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13ab8c-df86-4e9b-a61e-435b2675de49 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.622477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13ab8c-df86-4e9b-a61e-435b2675de49 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.622477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13ab8c-df86-4e9b-a61e-435b2675de49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:31.622477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13ab8c-df86-4e9b-a61e-435b2675de49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.622477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13ab8c-df86-4e9b-a61e-435b2675de49 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.636532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 265/525] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:31.637381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13ab8c-df86-4e9b-a61e-435b2675de49 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.668578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65382c-50b0-47a0-9b7c-ffb6696026d0 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.706973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3390b9-57a9-4692-9953-e2a493045493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.707710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3390b9-57a9-4692-9953-e2a493045493 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.707820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3390b9-57a9-4692-9953-e2a493045493 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.708114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3390b9-57a9-4692-9953-e2a493045493 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.708743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3390b9-57a9-4692-9953-e2a493045493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:31.709040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3390b9-57a9-4692-9953-e2a493045493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.710415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3390b9-57a9-4692-9953-e2a493045493 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.724193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 261/526] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:31.724925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3390b9-57a9-4692-9953-e2a493045493 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.730884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:31.745602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13ab8c-df86-4e9b-a61e-435b2675de49 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.782320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ce120-95d1-4d44-9854-552aad656c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.782956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ce120-95d1-4d44-9854-552aad656c78 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.783231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ce120-95d1-4d44-9854-552aad656c78 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.783500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ce120-95d1-4d44-9854-552aad656c78 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.792370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ce120-95d1-4d44-9854-552aad656c78 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.793886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ce120-95d1-4d44-9854-552aad656c78 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-389ce120-95d1-4d44-9854-552aad656c78 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:31.807133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:31.808059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:31.808945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 266/527] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:31.809533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ce120-95d1-4d44-9854-552aad656c78 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.853179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:31.857872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3390b9-57a9-4692-9953-e2a493045493 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.906457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e4df0-a5ab-4dc2-b206-4e409038cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.907491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e4df0-a5ab-4dc2-b206-4e409038cedc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.907491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e4df0-a5ab-4dc2-b206-4e409038cedc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.907682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e4df0-a5ab-4dc2-b206-4e409038cedc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.917018 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e4df0-a5ab-4dc2-b206-4e409038cedc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.918499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e4df0-a5ab-4dc2-b206-4e409038cedc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.921976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ce120-95d1-4d44-9854-552aad656c78 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-bd2e4df0-a5ab-4dc2-b206-4e409038cedc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:31.930968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:31.931847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:31.933618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:31.933618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:31.933618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:31.933618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:31.933618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:31.933618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:31.933618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:31.933618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:31.933618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 262/528] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:31.933618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e4df0-a5ab-4dc2-b206-4e409038cedc None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:31.967334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641ea9e-a968-4405-a3ab-38cad46e76e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:31.967995 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641ea9e-a968-4405-a3ab-38cad46e76e5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:31.968272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641ea9e-a968-4405-a3ab-38cad46e76e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:31.968543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641ea9e-a968-4405-a3ab-38cad46e76e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:31.969952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641ea9e-a968-4405-a3ab-38cad46e76e5 None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=34568b830fc641edab39324047368546) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:31.969952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641ea9e-a968-4405-a3ab-38cad46e76e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:31.971078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641ea9e-a968-4405-a3ab-38cad46e76e5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:31.977578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 267/529] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/role_assignments?user.id=34568b830fc641edab39324047368546&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:31.987137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641ea9e-a968-4405-a3ab-38cad46e76e5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:32.002877 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:32.048115 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e4df0-a5ab-4dc2-b206-4e409038cedc None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:32.093200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db99d0e-5c51-407e-85d3-a2d02c51e975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:32.093561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db99d0e-5c51-407e-85d3-a2d02c51e975 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:32.093768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db99d0e-5c51-407e-85d3-a2d02c51e975 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:32.094079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db99d0e-5c51-407e-85d3-a2d02c51e975 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:32.102582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db99d0e-5c51-407e-85d3-a2d02c51e975 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:32.104254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db99d0e-5c51-407e-85d3-a2d02c51e975 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-1db99d0e-5c51-407e-85d3-a2d02c51e975 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:32.117530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:32.118453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:32.119279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:32.119279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:32.119279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:32.119279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:32.119279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:32.119279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:32.119279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:32.119279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:32.119279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 263/530] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:32.119734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db99d0e-5c51-407e-85d3-a2d02c51e975 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:32.145158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641ea9e-a968-4405-a3ab-38cad46e76e5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:32.147965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:32.197803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e8b0-7729-426c-afb5-68be168f5a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:32.198894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e8b0-7729-426c-afb5-68be168f5a23 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:32.199894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e8b0-7729-426c-afb5-68be168f5a23 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:32.200316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e8b0-7729-426c-afb5-68be168f5a23 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:32.201638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8e8b0-7729-426c-afb5-68be168f5a23 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:32.202087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8e8b0-7729-426c-afb5-68be168f5a23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:32.204830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8e8b0-7729-426c-afb5-68be168f5a23 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:32.235960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db99d0e-5c51-407e-85d3-a2d02c51e975 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:32.261513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 268/531] 10.222.0.77 () {56 vars in 1139 bytes} [Wed Aug 10 22:41:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:32.261513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e8b0-7729-426c-afb5-68be168f5a23 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:32.267803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:32.280370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c2f40-b534-4ed5-bc49-4206e6f3a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:32.281279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2f40-b534-4ed5-bc49-4206e6f3a6b6 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:32.281676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2f40-b534-4ed5-bc49-4206e6f3a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:32.282070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2f40-b534-4ed5-bc49-4206e6f3a6b6 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:32.282834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c2f40-b534-4ed5-bc49-4206e6f3a6b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:32.283227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c2f40-b534-4ed5-bc49-4206e6f3a6b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:32.284963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c2f40-b534-4ed5-bc49-4206e6f3a6b6 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:32.306167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 264/532] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:32.307222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c2f40-b534-4ed5-bc49-4206e6f3a6b6 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:32.400274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e8b0-7729-426c-afb5-68be168f5a23 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:32.420838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c2f40-b534-4ed5-bc49-4206e6f3a6b6 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:32.451275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d55f2-d438-49cc-ab64-86ddb0efbafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:32.452689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d55f2-d438-49cc-ab64-86ddb0efbafc None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:32.453457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d55f2-d438-49cc-ab64-86ddb0efbafc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:32.454288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d55f2-d438-49cc-ab64-86ddb0efbafc None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:32.455421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d55f2-d438-49cc-ab64-86ddb0efbafc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:32.455872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d55f2-d438-49cc-ab64-86ddb0efbafc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:32.457846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d55f2-d438-49cc-ab64-86ddb0efbafc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:32.459650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf66aa9-04b5-481e-8ec0-046c3b12b7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:32.460503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf66aa9-04b5-481e-8ec0-046c3b12b7df None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:32.460885 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf66aa9-04b5-481e-8ec0-046c3b12b7df None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:32.461245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf66aa9-04b5-481e-8ec0-046c3b12b7df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:32.472902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 269/533] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:32.474538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d55f2-d438-49cc-ab64-86ddb0efbafc None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:32.496943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:32.532498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:32.555148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf66aa9-04b5-481e-8ec0-046c3b12b7df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:32.558943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf66aa9-04b5-481e-8ec0-046c3b12b7df None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:32.593421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d55f2-d438-49cc-ab64-86ddb0efbafc None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:32.629472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5245d-0995-41b7-9580-3b0e4699ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:32.630654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5245d-0995-41b7-9580-3b0e4699ba87 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:32.631213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5245d-0995-41b7-9580-3b0e4699ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:32.631213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5245d-0995-41b7-9580-3b0e4699ba87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:32.631887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5245d-0995-41b7-9580-3b0e4699ba87 None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=6e86be85010d4851a1ce3381832af230) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:32.632247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5245d-0995-41b7-9580-3b0e4699ba87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:32.633864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5245d-0995-41b7-9580-3b0e4699ba87 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:32.640461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 270/534] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:32 2022] GET /identity/v3/role_assignments?user.id=6e86be85010d4851a1ce3381832af230&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:32.641508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5245d-0995-41b7-9580-3b0e4699ba87 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:32.687801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 265/535] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:32.695103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf66aa9-04b5-481e-8ec0-046c3b12b7df None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:32.744848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:32.763551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5245d-0995-41b7-9580-3b0e4699ba87 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:32.815187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f0f5b-43aa-45ea-b2ff-ed5377de9204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:32.816206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f0f5b-43aa-45ea-b2ff-ed5377de9204 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:32.816669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f0f5b-43aa-45ea-b2ff-ed5377de9204 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:32.817121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f0f5b-43aa-45ea-b2ff-ed5377de9204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:32.818767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f0f5b-43aa-45ea-b2ff-ed5377de9204 None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=3eca4101d5a74563855c7fa3dcf1ccc0) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:32.819324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f0f5b-43aa-45ea-b2ff-ed5377de9204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:32.819818 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:32.822114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f0f5b-43aa-45ea-b2ff-ed5377de9204 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:32.833854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 271/536] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:32 2022] GET /identity/v3/role_assignments?user.id=3eca4101d5a74563855c7fa3dcf1ccc0&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:32.856662 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf66aa9-04b5-481e-8ec0-046c3b12b7df None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:32.917202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c72a44-8d36-4966-b8d5-5356c3de8658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:32.918384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72a44-8d36-4966-b8d5-5356c3de8658 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:32.918923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72a44-8d36-4966-b8d5-5356c3de8658 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:32.919411 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c72a44-8d36-4966-b8d5-5356c3de8658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:32.932701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c72a44-8d36-4966-b8d5-5356c3de8658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:32.938977 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c72a44-8d36-4966-b8d5-5356c3de8658 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d3c72a44-8d36-4966-b8d5-5356c3de8658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:32.962278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:32.963244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:32.964075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:32.964075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:32.964075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:32.973954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 266/537] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:32.982020 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f0f5b-43aa-45ea-b2ff-ed5377de9204 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:32.982610 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92e62-4de3-4cde-b33f-205c62b8c8e2 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:32.982894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92e62-4de3-4cde-b33f-205c62b8c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:32.983167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92e62-4de3-4cde-b33f-205c62b8c8e2 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:32.984696 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 267/538] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:41:32.991336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff38d8-be29-46b9-a54c-47c3dc1476df None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:32.991514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff38d8-be29-46b9-a54c-47c3dc1476df None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:32.991866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff38d8-be29-46b9-a54c-47c3dc1476df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:33.014873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-edff38d8-be29-46b9-a54c-47c3dc1476df None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:33.016804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-edff38d8-be29-46b9-a54c-47c3dc1476df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:33.129263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 268/539] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:41:33.129685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f0f5b-43aa-45ea-b2ff-ed5377de9204 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:33.158778 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff38d8-be29-46b9-a54c-47c3dc1476df None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:33.169595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cde900-b74f-412c-bac3-e038a920502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:33.170691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cde900-b74f-412c-bac3-e038a920502a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:33.170993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cde900-b74f-412c-bac3-e038a920502a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:33.171263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cde900-b74f-412c-bac3-e038a920502a None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:33.171914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cde900-b74f-412c-bac3-e038a920502a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:33.172215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cde900-b74f-412c-bac3-e038a920502a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:33.174371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cde900-b74f-412c-bac3-e038a920502a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:33.191968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 272/540] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:33.198878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cde900-b74f-412c-bac3-e038a920502a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:33.229412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:33.289731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:33.375569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff38d8-be29-46b9-a54c-47c3dc1476df None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:33.413951 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cde900-b74f-412c-bac3-e038a920502a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:33.421028 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b40e7-1c52-4abf-9a6d-d8323695edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:33.422061 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b40e7-1c52-4abf-9a6d-d8323695edb9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:33.422591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b40e7-1c52-4abf-9a6d-d8323695edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:33.423051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b40e7-1c52-4abf-9a6d-d8323695edb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:33.435420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b40e7-1c52-4abf-9a6d-d8323695edb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-257b40e7-1c52-4abf-9a6d-d8323695edb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:33.440668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:33.441582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:33.442474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:33.449751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 269/541] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:33.451687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b40e7-1c52-4abf-9a6d-d8323695edb9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:33.486617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec581235-406a-4a52-b4a8-565a64e08242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:33.487260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec581235-406a-4a52-b4a8-565a64e08242 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:33.487555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec581235-406a-4a52-b4a8-565a64e08242 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:33.487874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec581235-406a-4a52-b4a8-565a64e08242 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:33.500593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec581235-406a-4a52-b4a8-565a64e08242 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:33.502096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec581235-406a-4a52-b4a8-565a64e08242 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ec581235-406a-4a52-b4a8-565a64e08242 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:33.520746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:33.521674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:33.522487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:33.522487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:33.522487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:33.522487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:33.522487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:33.522487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:33.522487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:33.522487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:33.534098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 273/542] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:33.540342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec581235-406a-4a52-b4a8-565a64e08242 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:33.576010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b40e7-1c52-4abf-9a6d-d8323695edb9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:33.605413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:33.619603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238925a5-b9b9-4325-88e3-5d47edb98157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:33.620561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238925a5-b9b9-4325-88e3-5d47edb98157 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:33.621055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238925a5-b9b9-4325-88e3-5d47edb98157 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:33.621589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238925a5-b9b9-4325-88e3-5d47edb98157 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:33.622449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238925a5-b9b9-4325-88e3-5d47edb98157 None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:33.622981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238925a5-b9b9-4325-88e3-5d47edb98157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:33.624746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238925a5-b9b9-4325-88e3-5d47edb98157 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:33.646299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 270/543] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:33.649378 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238925a5-b9b9-4325-88e3-5d47edb98157 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:33.684596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:33.755500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec581235-406a-4a52-b4a8-565a64e08242 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:33.826895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afd7e0-ec31-490a-ac94-8e25d10c5202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:33.827506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afd7e0-ec31-490a-ac94-8e25d10c5202 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:33.829554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afd7e0-ec31-490a-ac94-8e25d10c5202 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:33.829830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afd7e0-ec31-490a-ac94-8e25d10c5202 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:33.830532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afd7e0-ec31-490a-ac94-8e25d10c5202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:33.830832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afd7e0-ec31-490a-ac94-8e25d10c5202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:33.832280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afd7e0-ec31-490a-ac94-8e25d10c5202 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:33.852040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238925a5-b9b9-4325-88e3-5d47edb98157 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:33.864646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 274/544] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:33.870941 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afd7e0-ec31-490a-ac94-8e25d10c5202 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:33.923505 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48debf06-491c-48cb-9f38-8f0e29e9cc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:33.924160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48debf06-491c-48cb-9f38-8f0e29e9cc98 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:33.924438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48debf06-491c-48cb-9f38-8f0e29e9cc98 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:33.924887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48debf06-491c-48cb-9f38-8f0e29e9cc98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:33.945240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48debf06-491c-48cb-9f38-8f0e29e9cc98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:33.946711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48debf06-491c-48cb-9f38-8f0e29e9cc98 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-48debf06-491c-48cb-9f38-8f0e29e9cc98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:33.986489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:33.987436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:33.988273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:33.988273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:33.988273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:33.988273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 271/545] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:33.991517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afd7e0-ec31-490a-ac94-8e25d10c5202 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:33.994003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48debf06-491c-48cb-9f38-8f0e29e9cc98 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:34.021766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:34.026352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e34dd4-4bc4-4039-930d-f86ac3f5d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:34.026953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e34dd4-4bc4-4039-930d-f86ac3f5d78c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:34.027227 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e34dd4-4bc4-4039-930d-f86ac3f5d78c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:34.027498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e34dd4-4bc4-4039-930d-f86ac3f5d78c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:34.032030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e34dd4-4bc4-4039-930d-f86ac3f5d78c None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=ff5c08bfc5e94b65bd4addde267e4598) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:34.032030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e34dd4-4bc4-4039-930d-f86ac3f5d78c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:34.032030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e34dd4-4bc4-4039-930d-f86ac3f5d78c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:34.041128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 275/546] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:33 2022] GET /identity/v3/role_assignments?user.id=ff5c08bfc5e94b65bd4addde267e4598&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:34.081742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:34.167875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48debf06-491c-48cb-9f38-8f0e29e9cc98 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:34.224142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327ba97-a4a0-4e95-bb5d-f0184ee6bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:34.224758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327ba97-a4a0-4e95-bb5d-f0184ee6bc9b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:34.225032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327ba97-a4a0-4e95-bb5d-f0184ee6bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:34.225315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327ba97-a4a0-4e95-bb5d-f0184ee6bc9b None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:34.225971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327ba97-a4a0-4e95-bb5d-f0184ee6bc9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:34.226269 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327ba97-a4a0-4e95-bb5d-f0184ee6bc9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:34.227623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327ba97-a4a0-4e95-bb5d-f0184ee6bc9b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:34.242765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 272/547] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:34.248092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e34dd4-4bc4-4039-930d-f86ac3f5d78c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:34.304197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee758fe-0dc8-46a8-930c-dc414baf4596 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:34.304448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee758fe-0dc8-46a8-930c-dc414baf4596 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:34.304675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee758fe-0dc8-46a8-930c-dc414baf4596 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:34.306191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 273/548] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:41:34.311883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4cced-674c-4567-8338-d3b21448cc78 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:34.316472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4cced-674c-4567-8338-d3b21448cc78 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:34.316472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4cced-674c-4567-8338-d3b21448cc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:34.341759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c7c4cced-674c-4567-8338-d3b21448cc78 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:34.344660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c7c4cced-674c-4567-8338-d3b21448cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:34.427370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 274/549] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:41:34.466411 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e34dd4-4bc4-4039-930d-f86ac3f5d78c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:34.471560 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4cced-674c-4567-8338-d3b21448cc78 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:34.533635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:34.536604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110c5c3-3cc5-4516-923b-5520cdfe61e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:34.537483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110c5c3-3cc5-4516-923b-5520cdfe61e2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:34.537608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110c5c3-3cc5-4516-923b-5520cdfe61e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:34.537844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110c5c3-3cc5-4516-923b-5520cdfe61e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:34.556848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110c5c3-3cc5-4516-923b-5520cdfe61e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:34.558324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110c5c3-3cc5-4516-923b-5520cdfe61e2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-2110c5c3-3cc5-4516-923b-5520cdfe61e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:34.589690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:34.590646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:34.591536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 276/550] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:41:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:34.598497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110c5c3-3cc5-4516-923b-5520cdfe61e2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:34.661952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4cced-674c-4567-8338-d3b21448cc78 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:34.701752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:34.732602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ceb9-4f5d-499f-8860-35463a269798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:34.733244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ceb9-4f5d-499f-8860-35463a269798 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:34.733545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ceb9-4f5d-499f-8860-35463a269798 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:34.733809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ceb9-4f5d-499f-8860-35463a269798 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:34.755608 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834ceb9-4f5d-499f-8860-35463a269798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-e834ceb9-4f5d-499f-8860-35463a269798 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:34.760468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:34.761576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:34.762413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:34.768515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 275/551] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:34.769460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ceb9-4f5d-499f-8860-35463a269798 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:34.793767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110c5c3-3cc5-4516-923b-5520cdfe61e2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:34.870254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f0138-1fc3-42eb-be12-fc44dfb10eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:34.870784 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f0138-1fc3-42eb-be12-fc44dfb10eb8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:34.871066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f0138-1fc3-42eb-be12-fc44dfb10eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:34.871402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f0138-1fc3-42eb-be12-fc44dfb10eb8 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:34.872143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f0138-1fc3-42eb-be12-fc44dfb10eb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:34.872449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f0138-1fc3-42eb-be12-fc44dfb10eb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:34.873930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f0138-1fc3-42eb-be12-fc44dfb10eb8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:34.881670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:34.894740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ceb9-4f5d-499f-8860-35463a269798 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:34.901695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 277/552] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Aug 10 22:41:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:34.914676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f0138-1fc3-42eb-be12-fc44dfb10eb8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:34.974555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4111c-ada2-466f-bf78-220f7fe7b244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:34.975413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4111c-ada2-466f-bf78-220f7fe7b244 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:34.975825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4111c-ada2-466f-bf78-220f7fe7b244 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:34.976328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4111c-ada2-466f-bf78-220f7fe7b244 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:34.977447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4111c-ada2-466f-bf78-220f7fe7b244 None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:34.977885 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4111c-ada2-466f-bf78-220f7fe7b244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:34.979392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4111c-ada2-466f-bf78-220f7fe7b244 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:34.999757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 276/553] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:35.004820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4111c-ada2-466f-bf78-220f7fe7b244 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:35.025320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f0138-1fc3-42eb-be12-fc44dfb10eb8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:35.037672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:35.075291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04384e6-b413-4833-8e65-ca48e1f707ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:35.075904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04384e6-b413-4833-8e65-ca48e1f707ac None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.076971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04384e6-b413-4833-8e65-ca48e1f707ac None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.077243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04384e6-b413-4833-8e65-ca48e1f707ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.163439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04384e6-b413-4833-8e65-ca48e1f707ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:35.164830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04384e6-b413-4833-8e65-ca48e1f707ac None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:35.211779 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4111c-ada2-466f-bf78-220f7fe7b244 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:35.256048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22abe1-d11f-47f7-8658-4c26e2844701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:35.256690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22abe1-d11f-47f7-8658-4c26e2844701 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.256966 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22abe1-d11f-47f7-8658-4c26e2844701 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.257232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22abe1-d11f-47f7-8658-4c26e2844701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.272568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 278/554] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:35.272816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22abe1-d11f-47f7-8658-4c26e2844701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:35.274281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22abe1-d11f-47f7-8658-4c26e2844701 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:35.277980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706f428-8217-470b-ac05-6f114d692289 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.278255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706f428-8217-470b-ac05-6f114d692289 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.278554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706f428-8217-470b-ac05-6f114d692289 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.280239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 279/555] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:35.281560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706f428-8217-470b-ac05-6f114d692289 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:35.295310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-2e22abe1-d11f-47f7-8658-4c26e2844701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:35.296191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:35.297315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:35.298325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:35.298325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:35.298325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:35.301381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 277/556] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:35.303978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb751-a4d0-4591-ae5f-66553c682e7d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.304438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb751-a4d0-4591-ae5f-66553c682e7d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.304852 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb751-a4d0-4591-ae5f-66553c682e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.315920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:35.330233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-283cb751-a4d0-4591-ae5f-66553c682e7d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:35.331619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-283cb751-a4d0-4591-ae5f-66553c682e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:35.429426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 278/557] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:35.429426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb751-a4d0-4591-ae5f-66553c682e7d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:35.449122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706f428-8217-470b-ac05-6f114d692289 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:35.486207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544e264-b60c-4197-9c16-c41c8bf31dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:35.486819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544e264-b60c-4197-9c16-c41c8bf31dc4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.487205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544e264-b60c-4197-9c16-c41c8bf31dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.487471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544e264-b60c-4197-9c16-c41c8bf31dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.499855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544e264-b60c-4197-9c16-c41c8bf31dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:35.501375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544e264-b60c-4197-9c16-c41c8bf31dc4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5544e264-b60c-4197-9c16-c41c8bf31dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:35.520314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:35.522444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:35.523438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:35.523438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:35.523438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:35.525444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 280/558] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:35.527020 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d750d9-dde5-4674-acdd-6805a973f122 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.527561 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d750d9-dde5-4674-acdd-6805a973f122 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.527831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d750d9-dde5-4674-acdd-6805a973f122 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.529587 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 281/559] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:35.530407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d750d9-dde5-4674-acdd-6805a973f122 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:35.557730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb751-a4d0-4591-ae5f-66553c682e7d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:35.596489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f727ae-75a0-46ab-804e-cebe8fd93d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:35.597102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f727ae-75a0-46ab-804e-cebe8fd93d11 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.597403 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f727ae-75a0-46ab-804e-cebe8fd93d11 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.597957 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f727ae-75a0-46ab-804e-cebe8fd93d11 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.598667 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f727ae-75a0-46ab-804e-cebe8fd93d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:35.598945 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f727ae-75a0-46ab-804e-cebe8fd93d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:35.600295 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f727ae-75a0-46ab-804e-cebe8fd93d11 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:35.601728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:35.601845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:35.612580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 279/560] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:35.613685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f727ae-75a0-46ab-804e-cebe8fd93d11 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:35.643615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d750d9-dde5-4674-acdd-6805a973f122 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:35.678417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3f8b6-fd59-4dbe-b353-8d320efc2a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:35.679189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3f8b6-fd59-4dbe-b353-8d320efc2a4c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.679531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3f8b6-fd59-4dbe-b353-8d320efc2a4c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.679744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3f8b6-fd59-4dbe-b353-8d320efc2a4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.690682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3f8b6-fd59-4dbe-b353-8d320efc2a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-67f3f8b6-fd59-4dbe-b353-8d320efc2a4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:35.696425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:35.697479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:35.698331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 282/561] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:35.699041 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d046696-2a96-4a49-b637-78ead74b66f6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.699041 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d046696-2a96-4a49-b637-78ead74b66f6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.699702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d046696-2a96-4a49-b637-78ead74b66f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.718585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4d046696-2a96-4a49-b637-78ead74b66f6 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:35.719761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4d046696-2a96-4a49-b637-78ead74b66f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:35.720281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f727ae-75a0-46ab-804e-cebe8fd93d11 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:35.754032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37aafc-0009-4cbe-8fd2-dc0ab4c5d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:35.754630 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37aafc-0009-4cbe-8fd2-dc0ab4c5d0da None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.755440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37aafc-0009-4cbe-8fd2-dc0ab4c5d0da None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.755704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37aafc-0009-4cbe-8fd2-dc0ab4c5d0da None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.756328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37aafc-0009-4cbe-8fd2-dc0ab4c5d0da None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:35.756623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37aafc-0009-4cbe-8fd2-dc0ab4c5d0da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:35.758319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37aafc-0009-4cbe-8fd2-dc0ab4c5d0da None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:35.776412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 280/562] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:35.777260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37aafc-0009-4cbe-8fd2-dc0ab4c5d0da None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:35.800294 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 283/563] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:35.801044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d046696-2a96-4a49-b637-78ead74b66f6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:35.844820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:35.866763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:35.894516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37aafc-0009-4cbe-8fd2-dc0ab4c5d0da None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:35.921759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d046696-2a96-4a49-b637-78ead74b66f6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:35.932812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2c064-3046-4c66-8cfb-87e7da49240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:35.933655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2c064-3046-4c66-8cfb-87e7da49240b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.933926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2c064-3046-4c66-8cfb-87e7da49240b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.934296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2c064-3046-4c66-8cfb-87e7da49240b None admin] PATH_INFO: `/v3/users/nova` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.948877 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2c064-3046-4c66-8cfb-87e7da49240b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:35.950359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2c064-3046-4c66-8cfb-87e7da49240b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:35.962851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136caa8-4fdd-4fc4-92e0-03ebcc302e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-b8a2c064-3046-4c66-8cfb-87e7da49240b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:35.963047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:35.963955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:35.964862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:35.964862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:35.964862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:35.964862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:35.964862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:35.964862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:35.964862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:35.964862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:35.964862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:41:35.964862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:35.965415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136caa8-4fdd-4fc4-92e0-03ebcc302e24 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:35.965415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136caa8-4fdd-4fc4-92e0-03ebcc302e24 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:35.965415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136caa8-4fdd-4fc4-92e0-03ebcc302e24 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:35.965415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136caa8-4fdd-4fc4-92e0-03ebcc302e24 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:35.965415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136caa8-4fdd-4fc4-92e0-03ebcc302e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:35.966344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136caa8-4fdd-4fc4-92e0-03ebcc302e24 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:35.968901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 281/564] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Aug 10 22:41:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:35.969868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2c064-3046-4c66-8cfb-87e7da49240b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:35.980223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 284/565] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:35.980223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136caa8-4fdd-4fc4-92e0-03ebcc302e24 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.081426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2c064-3046-4c66-8cfb-87e7da49240b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.092641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136caa8-4fdd-4fc4-92e0-03ebcc302e24 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.096830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:36.108221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:36.117493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12c7a1-ab56-47f7-b589-25bdfaffbb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.118198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12c7a1-ab56-47f7-b589-25bdfaffbb1c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.118479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12c7a1-ab56-47f7-b589-25bdfaffbb1c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.118741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12c7a1-ab56-47f7-b589-25bdfaffbb1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.125486 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12c7a1-ab56-47f7-b589-25bdfaffbb1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:36.126921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12c7a1-ab56-47f7-b589-25bdfaffbb1c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:36.129717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f8a2-2941-4b7b-8c8c-09797bab3138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.131136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f8a2-2941-4b7b-8c8c-09797bab3138 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.131591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f8a2-2941-4b7b-8c8c-09797bab3138 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.132033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f8a2-2941-4b7b-8c8c-09797bab3138 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-9e12c7a1-ab56-47f7-b589-25bdfaffbb1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:36.139490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:36.142563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:36.143455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:36.143455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:36.143455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:36.143455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:36.143455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:36.143455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:36.143455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:36.143455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:36.143455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 282/566] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:36.143455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12c7a1-ab56-47f7-b589-25bdfaffbb1c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.149466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9f8a2-2941-4b7b-8c8c-09797bab3138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-dbc9f8a2-2941-4b7b-8c8c-09797bab3138 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:36.154455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:36.155386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:36.156234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 285/567] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:36.156920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f8a2-2941-4b7b-8c8c-09797bab3138 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.260464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12c7a1-ab56-47f7-b589-25bdfaffbb1c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.264634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f8a2-2941-4b7b-8c8c-09797bab3138 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.296200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25809a3-98c0-4a7d-a356-413d92be9f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.296900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25809a3-98c0-4a7d-a356-413d92be9f41 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.297216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25809a3-98c0-4a7d-a356-413d92be9f41 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.297505 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25809a3-98c0-4a7d-a356-413d92be9f41 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.298317 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25809a3-98c0-4a7d-a356-413d92be9f41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:36.298773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25809a3-98c0-4a7d-a356-413d92be9f41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:36.299705 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498ef13-8f94-4882-bad7-d0a556f4d44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.300139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25809a3-98c0-4a7d-a356-413d92be9f41 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:36.300314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ef13-8f94-4882-bad7-d0a556f4d44e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.300588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ef13-8f94-4882-bad7-d0a556f4d44e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.300852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498ef13-8f94-4882-bad7-d0a556f4d44e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.312877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498ef13-8f94-4882-bad7-d0a556f4d44e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:36.322850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498ef13-8f94-4882-bad7-d0a556f4d44e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:36.322976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 283/568] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Aug 10 22:41:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:36.322976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25809a3-98c0-4a7d-a356-413d92be9f41 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-8498ef13-8f94-4882-bad7-d0a556f4d44e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:36.331869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:36.332912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:36.334140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:36.334140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:36.334140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:36.337592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 286/569] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:36.338491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498ef13-8f94-4882-bad7-d0a556f4d44e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.355077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:36.367745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:36.430646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25809a3-98c0-4a7d-a356-413d92be9f41 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.441175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498ef13-8f94-4882-bad7-d0a556f4d44e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.464233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be5d3a-862c-4420-ab2a-b770d912e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.464829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5d3a-862c-4420-ab2a-b770d912e2f1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.465108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5d3a-862c-4420-ab2a-b770d912e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.465410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5d3a-862c-4420-ab2a-b770d912e2f1 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.466296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be5d3a-862c-4420-ab2a-b770d912e2f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:36.466402 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be5d3a-862c-4420-ab2a-b770d912e2f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:36.467764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be5d3a-862c-4420-ab2a-b770d912e2f1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:36.474100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d49fc2-6c95-433c-ba5b-89c746aed8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.474686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d49fc2-6c95-433c-ba5b-89c746aed8dc None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.474962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d49fc2-6c95-433c-ba5b-89c746aed8dc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.475285 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d49fc2-6c95-433c-ba5b-89c746aed8dc None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.475867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d49fc2-6c95-433c-ba5b-89c746aed8dc None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:36.476159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d49fc2-6c95-433c-ba5b-89c746aed8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:36.477555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d49fc2-6c95-433c-ba5b-89c746aed8dc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:36.479708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 284/570] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:36.480500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be5d3a-862c-4420-ab2a-b770d912e2f1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.490645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 287/571] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:36.490645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d49fc2-6c95-433c-ba5b-89c746aed8dc None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.573720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:36.579441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:36.582313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be5d3a-862c-4420-ab2a-b770d912e2f1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.590946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d49fc2-6c95-433c-ba5b-89c746aed8dc None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.616992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eb51f-f50e-4406-87ad-2e0652be1a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.617642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eb51f-f50e-4406-87ad-2e0652be1a11 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.617918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eb51f-f50e-4406-87ad-2e0652be1a11 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.618183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25eb51f-f50e-4406-87ad-2e0652be1a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.624432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482f5c-1323-4aea-8a1d-6e33f55159fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.625224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482f5c-1323-4aea-8a1d-6e33f55159fc None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.625540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482f5c-1323-4aea-8a1d-6e33f55159fc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.625903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482f5c-1323-4aea-8a1d-6e33f55159fc None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.626551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482f5c-1323-4aea-8a1d-6e33f55159fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:36.626850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482f5c-1323-4aea-8a1d-6e33f55159fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:36.628146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25eb51f-f50e-4406-87ad-2e0652be1a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:36.628261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482f5c-1323-4aea-8a1d-6e33f55159fc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:36.629599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25eb51f-f50e-4406-87ad-2e0652be1a11 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:36.640291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 288/572] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:36.641495 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65fb6d-6917-41c5-a1d8-4370629d834e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.641774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65fb6d-6917-41c5-a1d8-4370629d834e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.642041 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65fb6d-6917-41c5-a1d8-4370629d834e None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.648246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 289/573] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d25eb51f-f50e-4406-87ad-2e0652be1a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:36.648409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:36.649465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:36.650611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:36.650611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:36.650611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:36.650810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65fb6d-6917-41c5-a1d8-4370629d834e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.650902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 285/574] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:36.650902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eb51f-f50e-4406-87ad-2e0652be1a11 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.749684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25eb51f-f50e-4406-87ad-2e0652be1a11 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.750332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65fb6d-6917-41c5-a1d8-4370629d834e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.784546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3c517-7b48-41ef-934c-8bbe4594ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.785177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3c517-7b48-41ef-934c-8bbe4594ef63 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.785480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3c517-7b48-41ef-934c-8bbe4594ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.785750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3c517-7b48-41ef-934c-8bbe4594ef63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.786088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39eda4-602c-438a-801a-40dfec43449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.787197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39eda4-602c-438a-801a-40dfec43449c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.787470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39eda4-602c-438a-801a-40dfec43449c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.787734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39eda4-602c-438a-801a-40dfec43449c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.788499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39eda4-602c-438a-801a-40dfec43449c None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=6c892a519c8348728d43f0f0d447a321) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:36.788742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39eda4-602c-438a-801a-40dfec43449c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:36.790213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39eda4-602c-438a-801a-40dfec43449c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:36.796097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 290/575] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:36 2022] GET /identity/v3/role_assignments?user.id=6c892a519c8348728d43f0f0d447a321&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:36.796870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39eda4-602c-438a-801a-40dfec43449c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.797138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3c517-7b48-41ef-934c-8bbe4594ef63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:36.798591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3c517-7b48-41ef-934c-8bbe4594ef63 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:36.810689 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:36.823490 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-cfd3c517-7b48-41ef-934c-8bbe4594ef63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:36.823718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:36.824757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:36.830732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:36.830732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:36.830732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:36.830732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 286/576] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:36.830732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f4f4-7730-42d2-874a-827b12911a87 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.830732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f4f4-7730-42d2-874a-827b12911a87 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.830732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6f4f4-7730-42d2-874a-827b12911a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.847328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-feb6f4f4-7730-42d2-874a-827b12911a87 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:36.849453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-feb6f4f4-7730-42d2-874a-827b12911a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:36.937705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 287/577] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:36.938375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39eda4-602c-438a-801a-40dfec43449c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:36.938462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6f4f4-7730-42d2-874a-827b12911a87 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:36.977834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940bbb5-fac0-4c36-93b7-80db631b0bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:36.978785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940bbb5-fac0-4c36-93b7-80db631b0bfb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:36.979371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940bbb5-fac0-4c36-93b7-80db631b0bfb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:36.979600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940bbb5-fac0-4c36-93b7-80db631b0bfb None admin] PATH_INFO: `/v3/users/glance` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:36.988928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940bbb5-fac0-4c36-93b7-80db631b0bfb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:36.990569 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940bbb5-fac0-4c36-93b7-80db631b0bfb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-b940bbb5-fac0-4c36-93b7-80db631b0bfb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:37.002202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:37.003383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:37.004530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:37.004530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:37.004530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:37.004530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:37.004530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:37.004530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:37.004530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:37.004530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:37.004530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 22:41:37.004530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:37.005644 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 291/578] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:37.006286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940bbb5-fac0-4c36-93b7-80db631b0bfb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:37.060121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6f4f4-7730-42d2-874a-827b12911a87 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:37.087960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:37.089791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:37.097052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0bda-0eb1-440a-8d53-fab2930de1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:37.097949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0bda-0eb1-440a-8d53-fab2930de1a1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:37.098465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0bda-0eb1-440a-8d53-fab2930de1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:37.098465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0bda-0eb1-440a-8d53-fab2930de1a1 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:37.099203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c0bda-0eb1-440a-8d53-fab2930de1a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:37.099489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c0bda-0eb1-440a-8d53-fab2930de1a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:37.100804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c0bda-0eb1-440a-8d53-fab2930de1a1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:37.113487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 288/579] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:37.114353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0bda-0eb1-440a-8d53-fab2930de1a1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:37.124423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940bbb5-fac0-4c36-93b7-80db631b0bfb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:37.161879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3cb3-7f72-4f98-b38c-0028baf70616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:37.162791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3cb3-7f72-4f98-b38c-0028baf70616 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:37.163075 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3cb3-7f72-4f98-b38c-0028baf70616 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:37.163344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3cb3-7f72-4f98-b38c-0028baf70616 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:37.163983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff3cb3-7f72-4f98-b38c-0028baf70616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:37.164281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff3cb3-7f72-4f98-b38c-0028baf70616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:37.165670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff3cb3-7f72-4f98-b38c-0028baf70616 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:37.183880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 292/580] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:37.183880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3cb3-7f72-4f98-b38c-0028baf70616 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:37.243152 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0bda-0eb1-440a-8d53-fab2930de1a1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:37.280432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be7893-b00a-46a9-be8d-64ac7e9c4106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:37.281398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be7893-b00a-46a9-be8d-64ac7e9c4106 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:37.281846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be7893-b00a-46a9-be8d-64ac7e9c4106 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:37.282253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be7893-b00a-46a9-be8d-64ac7e9c4106 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:37.287271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3cb3-7f72-4f98-b38c-0028baf70616 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:37.295400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be7893-b00a-46a9-be8d-64ac7e9c4106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-b2be7893-b00a-46a9-be8d-64ac7e9c4106 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:37.300497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:37.301444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 289/581] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:37.306528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be7893-b00a-46a9-be8d-64ac7e9c4106 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:37.326982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:37.334136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611050f3-8921-40db-9727-41e9ab74b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:37.334954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611050f3-8921-40db-9727-41e9ab74b2fd None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:37.335376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611050f3-8921-40db-9727-41e9ab74b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:37.335818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611050f3-8921-40db-9727-41e9ab74b2fd None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:37.336754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611050f3-8921-40db-9727-41e9ab74b2fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:37.337060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611050f3-8921-40db-9727-41e9ab74b2fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:37.338634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611050f3-8921-40db-9727-41e9ab74b2fd None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:37.362164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 293/582] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Aug 10 22:41:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:37.363572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611050f3-8921-40db-9727-41e9ab74b2fd None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:37.407756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:37.475180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be7893-b00a-46a9-be8d-64ac7e9c4106 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:37.507306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611050f3-8921-40db-9727-41e9ab74b2fd None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:37.514714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe52fe-d78d-4c10-8b90-cea63669960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:37.515352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe52fe-d78d-4c10-8b90-cea63669960a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:37.515624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe52fe-d78d-4c10-8b90-cea63669960a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:37.515886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe52fe-d78d-4c10-8b90-cea63669960a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:37.525701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe52fe-d78d-4c10-8b90-cea63669960a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:37.527430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe52fe-d78d-4c10-8b90-cea63669960a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-bcfe52fe-d78d-4c10-8b90-cea63669960a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:37.543711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:37.544891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:37.549855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:37.549855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:37.549855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:37.549855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:37.549855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:37.549855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:37.549855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:37.549855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:37.549855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 290/583] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:37.549855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe52fe-d78d-4c10-8b90-cea63669960a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:37.553582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9269-989f-46a6-9605-42cbb18c7132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:37.553582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9269-989f-46a6-9605-42cbb18c7132 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:37.553582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9269-989f-46a6-9605-42cbb18c7132 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:37.553582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa9269-989f-46a6-9605-42cbb18c7132 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:37.563696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa9269-989f-46a6-9605-42cbb18c7132 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:37.565153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa9269-989f-46a6-9605-42cbb18c7132 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-7dfa9269-989f-46a6-9605-42cbb18c7132 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:37.577534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:37.578684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:37.579909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:37.579909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:37.579909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:37.579909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:37.579909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:37.579909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:37.579909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:37.579909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:37.579909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 22:41:37.579909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:37.583497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 294/584] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:37.584560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9269-989f-46a6-9605-42cbb18c7132 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:37.662507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:37.697612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe52fe-d78d-4c10-8b90-cea63669960a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:37.704929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:37.719193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa9269-989f-46a6-9605-42cbb18c7132 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:37.734492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaa033-7eb6-4e91-ad58-b0a17af13600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:37.735187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaa033-7eb6-4e91-ad58-b0a17af13600 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:37.735534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaa033-7eb6-4e91-ad58-b0a17af13600 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:37.735856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deaa033-7eb6-4e91-ad58-b0a17af13600 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:37.736597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaa033-7eb6-4e91-ad58-b0a17af13600 None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:37.737120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaa033-7eb6-4e91-ad58-b0a17af13600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:37.739047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deaa033-7eb6-4e91-ad58-b0a17af13600 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:37.752538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 291/585] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:37.752538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaa033-7eb6-4e91-ad58-b0a17af13600 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:37.762938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164228b-026e-4f3f-bb8d-3d56e600691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:37.763698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164228b-026e-4f3f-bb8d-3d56e600691b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:37.764048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164228b-026e-4f3f-bb8d-3d56e600691b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:37.764383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164228b-026e-4f3f-bb8d-3d56e600691b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:37.775989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164228b-026e-4f3f-bb8d-3d56e600691b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:37.777565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164228b-026e-4f3f-bb8d-3d56e600691b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f164228b-026e-4f3f-bb8d-3d56e600691b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:37.792939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:37.794018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:37.799748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:37.799748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:37.799748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:37.799748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 295/586] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:37.799748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164228b-026e-4f3f-bb8d-3d56e600691b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:37.871801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deaa033-7eb6-4e91-ad58-b0a17af13600 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:37.912731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50d6fd-f1da-48eb-84e8-afee0806b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:37.913076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50d6fd-f1da-48eb-84e8-afee0806b336 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:37.913319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50d6fd-f1da-48eb-84e8-afee0806b336 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:37.913768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50d6fd-f1da-48eb-84e8-afee0806b336 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:37.914275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50d6fd-f1da-48eb-84e8-afee0806b336 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:37.914834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50d6fd-f1da-48eb-84e8-afee0806b336 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:37.915983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50d6fd-f1da-48eb-84e8-afee0806b336 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:37.921374 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164228b-026e-4f3f-bb8d-3d56e600691b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:37.923132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:37.937145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 292/587] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:37.937145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50d6fd-f1da-48eb-84e8-afee0806b336 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:37.971576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fca84-99b8-4410-8eca-f46583d6a048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:37.972857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fca84-99b8-4410-8eca-f46583d6a048 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:37.974257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fca84-99b8-4410-8eca-f46583d6a048 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:37.974257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fca84-99b8-4410-8eca-f46583d6a048 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:37.975027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fca84-99b8-4410-8eca-f46583d6a048 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:37.975368 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fca84-99b8-4410-8eca-f46583d6a048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:37.976830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fca84-99b8-4410-8eca-f46583d6a048 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:37.979061 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:38.005001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 296/588] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Aug 10 22:41:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:38.005001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fca84-99b8-4410-8eca-f46583d6a048 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:38.068642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50d6fd-f1da-48eb-84e8-afee0806b336 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:38.108129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8207-0517-4584-8717-260b02dc0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:38.108968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8207-0517-4584-8717-260b02dc0d7c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:38.109332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8207-0517-4584-8717-260b02dc0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:38.109580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df8207-0517-4584-8717-260b02dc0d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:38.111531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fca84-99b8-4410-8eca-f46583d6a048 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:38.120735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df8207-0517-4584-8717-260b02dc0d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:38.122215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df8207-0517-4584-8717-260b02dc0d7c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-a1df8207-0517-4584-8717-260b02dc0d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:38.137932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:38.138971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:38.144997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:38.144997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:38.144997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:38.144997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 293/589] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:38.144997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8207-0517-4584-8717-260b02dc0d7c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:38.163442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e4054-acd7-4855-9482-612a6719f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:38.163971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e4054-acd7-4855-9482-612a6719f1a7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:38.164256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e4054-acd7-4855-9482-612a6719f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:38.164628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e4054-acd7-4855-9482-612a6719f1a7 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:38.165281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e4054-acd7-4855-9482-612a6719f1a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:38.165614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e4054-acd7-4855-9482-612a6719f1a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:38.166979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e4054-acd7-4855-9482-612a6719f1a7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:38.184641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 297/590] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:38.184641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e4054-acd7-4855-9482-612a6719f1a7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:38.211606 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:38.239728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:38.260622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df8207-0517-4584-8717-260b02dc0d7c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:38.295790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e4054-acd7-4855-9482-612a6719f1a7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:38.298271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce03d8-6b76-4268-bd25-b70dd570938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:38.298950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce03d8-6b76-4268-bd25-b70dd570938f None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:38.299228 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce03d8-6b76-4268-bd25-b70dd570938f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:38.299501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce03d8-6b76-4268-bd25-b70dd570938f None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/34568b830fc641edab39324047368546/roles/4287d802f16f48e99bde5dad08836906` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:38.317339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce03d8-6b76-4268-bd25-b70dd570938f None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=34568b830fc641edab39324047368546, role_id=4287d802f16f48e99bde5dad08836906)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:38.318845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce03d8-6b76-4268-bd25-b70dd570938f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:38.334450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20952d-a5a5-43f8-a7e8-c3cc07215ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:38.335072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20952d-a5a5-43f8-a7e8-c3cc07215ca4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:38.335345 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20952d-a5a5-43f8-a7e8-c3cc07215ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:38.335610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20952d-a5a5-43f8-a7e8-c3cc07215ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:38.347423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20952d-a5a5-43f8-a7e8-c3cc07215ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:38.349746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20952d-a5a5-43f8-a7e8-c3cc07215ca4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-9a20952d-a5a5-43f8-a7e8-c3cc07215ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:38.364134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:38.365246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:38.366157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:38.366157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:38.366157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:38.366157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 298/591] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:38.366157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20952d-a5a5-43f8-a7e8-c3cc07215ca4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:38.438989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:38.452722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 294/592] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:41:38 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/34568b830fc641edab39324047368546/roles/4287d802f16f48e99bde5dad08836906 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:38.453512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce03d8-6b76-4268-bd25-b70dd570938f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:38.486477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20952d-a5a5-43f8-a7e8-c3cc07215ca4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:38.541624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fbb61-25c1-4ac6-a336-48036aa86216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:38.542521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fbb61-25c1-4ac6-a336-48036aa86216 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:38.542985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fbb61-25c1-4ac6-a336-48036aa86216 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:38.543481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fbb61-25c1-4ac6-a336-48036aa86216 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:38.544649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fbb61-25c1-4ac6-a336-48036aa86216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:38.545124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fbb61-25c1-4ac6-a336-48036aa86216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:38.547999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fbb61-25c1-4ac6-a336-48036aa86216 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:38.570362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 299/593] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:38.572429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fbb61-25c1-4ac6-a336-48036aa86216 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:38.593905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce03d8-6b76-4268-bd25-b70dd570938f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:38.628000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:38.639695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e63d-ad77-4f7b-9b17-6e87ef3f76f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:38.641167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e63d-ad77-4f7b-9b17-6e87ef3f76f5 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:38.641167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e63d-ad77-4f7b-9b17-6e87ef3f76f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:38.641167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e63d-ad77-4f7b-9b17-6e87ef3f76f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:38.656955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37e63d-ad77-4f7b-9b17-6e87ef3f76f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:38.658861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37e63d-ad77-4f7b-9b17-6e87ef3f76f5 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-3d37e63d-ad77-4f7b-9b17-6e87ef3f76f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:38.674911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:38.675872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:38.677230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:38.677230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:38.677230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:38.677230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:38.677230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:38.677230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:38.677230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:38.677230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:38.677230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 295/594] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:38.677230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e63d-ad77-4f7b-9b17-6e87ef3f76f5 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:38.740193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fbb61-25c1-4ac6-a336-48036aa86216 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:38.776292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:38.792096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ec95d-9980-4953-af44-2a849a8724a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:38.793036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ec95d-9980-4953-af44-2a849a8724a8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:38.793900 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ec95d-9980-4953-af44-2a849a8724a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:38.794023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ec95d-9980-4953-af44-2a849a8724a8 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:38.794924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ec95d-9980-4953-af44-2a849a8724a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:38.795396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ec95d-9980-4953-af44-2a849a8724a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:38.796922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ec95d-9980-4953-af44-2a849a8724a8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:38.811277 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 300/595] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:38.815971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ec95d-9980-4953-af44-2a849a8724a8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:38.834784 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e63d-ad77-4f7b-9b17-6e87ef3f76f5 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:38.885580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e176-f654-40b6-ae8a-df4af15a849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:38.886306 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e176-f654-40b6-ae8a-df4af15a849f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:38.886478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e176-f654-40b6-ae8a-df4af15a849f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:38.886749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94e176-f654-40b6-ae8a-df4af15a849f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:38.894713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94e176-f654-40b6-ae8a-df4af15a849f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:38.896234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94e176-f654-40b6-ae8a-df4af15a849f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-1c94e176-f654-40b6-ae8a-df4af15a849f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:38.908050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:38.908993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 296/596] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:38.909980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e176-f654-40b6-ae8a-df4af15a849f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:38.936439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ec95d-9980-4953-af44-2a849a8724a8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:38.967846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:38.975437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fe093-a178-46e6-8c6d-48865a8c3891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:38.976315 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fe093-a178-46e6-8c6d-48865a8c3891 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:38.976588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fe093-a178-46e6-8c6d-48865a8c3891 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:38.976864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fe093-a178-46e6-8c6d-48865a8c3891 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:38.977677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fe093-a178-46e6-8c6d-48865a8c3891 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:38.984471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fe093-a178-46e6-8c6d-48865a8c3891 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:38.984471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fe093-a178-46e6-8c6d-48865a8c3891 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:38.997444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 301/597] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:38.997444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f19330-8395-4006-bebd-ec37664ee856 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:38.997444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f19330-8395-4006-bebd-ec37664ee856 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:38.997444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f19330-8395-4006-bebd-ec37664ee856 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:38.997444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 302/598] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:38.997444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f19330-8395-4006-bebd-ec37664ee856 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:39.040518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94e176-f654-40b6-ae8a-df4af15a849f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:39.064906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:39.085735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57205b2c-01ad-442e-a9d2-c16a3d65f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:39.086633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57205b2c-01ad-442e-a9d2-c16a3d65f8da None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:39.086907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57205b2c-01ad-442e-a9d2-c16a3d65f8da None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:39.087172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57205b2c-01ad-442e-a9d2-c16a3d65f8da None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:39.099571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57205b2c-01ad-442e-a9d2-c16a3d65f8da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:39.102763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57205b2c-01ad-442e-a9d2-c16a3d65f8da None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:39.119669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f19330-8395-4006-bebd-ec37664ee856 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-57205b2c-01ad-442e-a9d2-c16a3d65f8da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:39.124010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:39.124864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:39.126121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:39.126121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:39.126121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:39.126121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:39.126121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:39.126121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:39.126121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:39.126121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:39.126556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 297/599] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:39.128089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c275bfe-eb44-4749-981c-8c97fd49d450 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:39.128404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c275bfe-eb44-4749-981c-8c97fd49d450 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:39.128874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c275bfe-eb44-4749-981c-8c97fd49d450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:39.152062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-8c275bfe-eb44-4749-981c-8c97fd49d450 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:39.153422 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8c275bfe-eb44-4749-981c-8c97fd49d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:39.170170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962e106-f3ee-4cfa-8850-893fd348a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:39.170946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962e106-f3ee-4cfa-8850-893fd348a624 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:39.171247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962e106-f3ee-4cfa-8850-893fd348a624 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:39.171487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962e106-f3ee-4cfa-8850-893fd348a624 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:39.172252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962e106-f3ee-4cfa-8850-893fd348a624 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:39.172565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962e106-f3ee-4cfa-8850-893fd348a624 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:39.174134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962e106-f3ee-4cfa-8850-893fd348a624 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:39.201040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 303/600] 10.222.0.77 () {56 vars in 1139 bytes} [Wed Aug 10 22:41:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:39.206246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962e106-f3ee-4cfa-8850-893fd348a624 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:39.261460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 298/601] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:39.261460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c275bfe-eb44-4749-981c-8c97fd49d450 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:39.320211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:39.362593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962e106-f3ee-4cfa-8850-893fd348a624 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:39.385186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:39.424410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c275bfe-eb44-4749-981c-8c97fd49d450 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:39.425931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e10901-7a4e-4dd6-9d7b-464736407a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:39.427648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e10901-7a4e-4dd6-9d7b-464736407a59 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:39.429079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e10901-7a4e-4dd6-9d7b-464736407a59 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:39.429079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e10901-7a4e-4dd6-9d7b-464736407a59 None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/6e86be85010d4851a1ce3381832af230/roles/4287d802f16f48e99bde5dad08836906` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:39.456415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e10901-7a4e-4dd6-9d7b-464736407a59 None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=6e86be85010d4851a1ce3381832af230, role_id=4287d802f16f48e99bde5dad08836906)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:39.458002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e10901-7a4e-4dd6-9d7b-464736407a59 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:39.470510 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346dad2-18f7-450a-adcc-798f8da240cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:39.476569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346dad2-18f7-450a-adcc-798f8da240cc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:39.476569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346dad2-18f7-450a-adcc-798f8da240cc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:39.476569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346dad2-18f7-450a-adcc-798f8da240cc None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:39.476569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346dad2-18f7-450a-adcc-798f8da240cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:39.476569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346dad2-18f7-450a-adcc-798f8da240cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:39.477760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346dad2-18f7-450a-adcc-798f8da240cc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:39.498514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 299/602] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:39.499523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346dad2-18f7-450a-adcc-798f8da240cc None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:39.537704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 304/603] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:41:39 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/6e86be85010d4851a1ce3381832af230/roles/4287d802f16f48e99bde5dad08836906 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:39.549699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e10901-7a4e-4dd6-9d7b-464736407a59 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:39.685267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:39.690764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346dad2-18f7-450a-adcc-798f8da240cc None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:39.742417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e10901-7a4e-4dd6-9d7b-464736407a59 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:39.767580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d898b-fb7f-4be4-9f5e-6663a89f5d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:39.769199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d898b-fb7f-4be4-9f5e-6663a89f5d59 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:39.770185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d898b-fb7f-4be4-9f5e-6663a89f5d59 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:39.771599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d898b-fb7f-4be4-9f5e-6663a89f5d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:39.784854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc3974-08b1-46bd-bdd6-454fe59eeb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:39.785577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3974-08b1-46bd-bdd6-454fe59eeb73 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:39.785812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3974-08b1-46bd-bdd6-454fe59eeb73 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:39.786818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc3974-08b1-46bd-bdd6-454fe59eeb73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:39.797448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d898b-fb7f-4be4-9f5e-6663a89f5d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:39.797448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d898b-fb7f-4be4-9f5e-6663a89f5d59 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:39.804194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc3974-08b1-46bd-bdd6-454fe59eeb73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-4fbc3974-08b1-46bd-bdd6-454fe59eeb73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:39.809750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:39.811980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 305/604] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:39.813777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc3974-08b1-46bd-bdd6-454fe59eeb73 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:39.837156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-794d898b-fb7f-4be4-9f5e-6663a89f5d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:39.839190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:39.840911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:39.842533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:39.842533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:39.842533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:39.846107 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 300/605] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:39.847904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d898b-fb7f-4be4-9f5e-6663a89f5d59 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:39.930229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc3974-08b1-46bd-bdd6-454fe59eeb73 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:39.968176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b110e-d4bf-4c20-9078-b3f12c419ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:39.968176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b110e-d4bf-4c20-9078-b3f12c419ffb None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:39.968609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b110e-d4bf-4c20-9078-b3f12c419ffb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:39.968748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b110e-d4bf-4c20-9078-b3f12c419ffb None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/3eca4101d5a74563855c7fa3dcf1ccc0/roles/4287d802f16f48e99bde5dad08836906` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:39.986296 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b110e-d4bf-4c20-9078-b3f12c419ffb None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=3eca4101d5a74563855c7fa3dcf1ccc0, role_id=4287d802f16f48e99bde5dad08836906)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:39.988031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b110e-d4bf-4c20-9078-b3f12c419ffb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:40.015036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d898b-fb7f-4be4-9f5e-6663a89f5d59 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:40.061880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c3b6-fd7b-4144-b784-8c1f560382b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:40.062841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c3b6-fd7b-4144-b784-8c1f560382b5 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:40.063232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c3b6-fd7b-4144-b784-8c1f560382b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:40.063707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c3b6-fd7b-4144-b784-8c1f560382b5 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:40.064858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5c3b6-fd7b-4144-b784-8c1f560382b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:40.065180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5c3b6-fd7b-4144-b784-8c1f560382b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:40.067029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5c3b6-fd7b-4144-b784-8c1f560382b5 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:40.085602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 301/606] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:40.087038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c3b6-fd7b-4144-b784-8c1f560382b5 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:40.102588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 306/607] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:41:39 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/3eca4101d5a74563855c7fa3dcf1ccc0/roles/4287d802f16f48e99bde5dad08836906 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:40.103526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b110e-d4bf-4c20-9078-b3f12c419ffb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:40.113116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:40.263070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:40.304772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b110e-d4bf-4c20-9078-b3f12c419ffb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:40.347056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c3b6-fd7b-4144-b784-8c1f560382b5 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:40.351416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec268b91-c9a0-49ac-9d0e-ed7e0b409fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:40.352124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec268b91-c9a0-49ac-9d0e-ed7e0b409fb3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:40.352402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec268b91-c9a0-49ac-9d0e-ed7e0b409fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:40.352677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec268b91-c9a0-49ac-9d0e-ed7e0b409fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:40.368320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec268b91-c9a0-49ac-9d0e-ed7e0b409fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:40.370664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec268b91-c9a0-49ac-9d0e-ed7e0b409fb3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ec268b91-c9a0-49ac-9d0e-ed7e0b409fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:40.390854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:40.392551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:40.394298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:40.394298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:40.394298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:40.394298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 307/608] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:40.400235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec268b91-c9a0-49ac-9d0e-ed7e0b409fb3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:40.403867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181b21a-392f-4346-916d-1994fdeb0bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:40.404609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b21a-392f-4346-916d-1994fdeb0bfb None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:40.404879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b21a-392f-4346-916d-1994fdeb0bfb None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:40.405142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b21a-392f-4346-916d-1994fdeb0bfb None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:40.405837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181b21a-392f-4346-916d-1994fdeb0bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:40.406118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181b21a-392f-4346-916d-1994fdeb0bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:40.407549 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181b21a-392f-4346-916d-1994fdeb0bfb None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:40.422909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 302/609] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:40.434593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181b21a-392f-4346-916d-1994fdeb0bfb None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:40.524418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec268b91-c9a0-49ac-9d0e-ed7e0b409fb3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:40.553799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:40.571394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ecbd7-844f-42f7-b1b5-42bb73f22925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:40.572128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ecbd7-844f-42f7-b1b5-42bb73f22925 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:40.572507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ecbd7-844f-42f7-b1b5-42bb73f22925 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:40.573209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ecbd7-844f-42f7-b1b5-42bb73f22925 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:40.573928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ecbd7-844f-42f7-b1b5-42bb73f22925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:40.574298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ecbd7-844f-42f7-b1b5-42bb73f22925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:40.576103 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ecbd7-844f-42f7-b1b5-42bb73f22925 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:40.590872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 308/610] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:40.600988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ecbd7-844f-42f7-b1b5-42bb73f22925 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:40.616184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:40.684612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181b21a-392f-4346-916d-1994fdeb0bfb None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:40.745353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61efb46-2c2a-4fa8-8fb6-53057746b2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:40.745353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61efb46-2c2a-4fa8-8fb6-53057746b2cb None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:40.745353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61efb46-2c2a-4fa8-8fb6-53057746b2cb None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:40.745353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61efb46-2c2a-4fa8-8fb6-53057746b2cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:40.753060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61efb46-2c2a-4fa8-8fb6-53057746b2cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:40.755356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61efb46-2c2a-4fa8-8fb6-53057746b2cb None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-e61efb46-2c2a-4fa8-8fb6-53057746b2cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:40.769903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:40.771437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:40.772543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:40.772543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:40.772543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:40.772543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:40.772543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:40.772543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:40.772543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:40.772543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:40.772543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 303/611] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:40.778563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61efb46-2c2a-4fa8-8fb6-53057746b2cb None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:40.841472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ecbd7-844f-42f7-b1b5-42bb73f22925 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:40.896519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0bb6f-491f-4a6e-8b93-bdf3b0864a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:40.897461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0bb6f-491f-4a6e-8b93-bdf3b0864a56 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:40.897960 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0bb6f-491f-4a6e-8b93-bdf3b0864a56 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:40.898376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0bb6f-491f-4a6e-8b93-bdf3b0864a56 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:40.910982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0bb6f-491f-4a6e-8b93-bdf3b0864a56 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:40.913465 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0bb6f-491f-4a6e-8b93-bdf3b0864a56 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-61c0bb6f-491f-4a6e-8b93-bdf3b0864a56 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:40.934506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:40.935531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:40.936448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:40.936448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:40.936448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:40.936448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:40.936448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:40.936448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:40.936448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:40.936448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:40.936448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:41:40.936448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:40.937717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 309/612] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:41:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:40.945958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0bb6f-491f-4a6e-8b93-bdf3b0864a56 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:40.962484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61efb46-2c2a-4fa8-8fb6-53057746b2cb None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:41.022430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:41.034714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c65d5-a671-45b4-a67c-d9a1b5d9d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:41.035742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c65d5-a671-45b4-a67c-d9a1b5d9d456 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:41.036254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c65d5-a671-45b4-a67c-d9a1b5d9d456 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:41.036719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c65d5-a671-45b4-a67c-d9a1b5d9d456 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:41.037661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c65d5-a671-45b4-a67c-d9a1b5d9d456 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:41.038212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c65d5-a671-45b4-a67c-d9a1b5d9d456 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:41.039887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c65d5-a671-45b4-a67c-d9a1b5d9d456 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:41.041921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:41.063801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 304/613] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:41.086873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0ea7f-c891-4aad-89c8-e18eab21fe4b None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:41.087176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0ea7f-c891-4aad-89c8-e18eab21fe4b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:41.087434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0ea7f-c891-4aad-89c8-e18eab21fe4b None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:41.089094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 305/614] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:41.089637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0ea7f-c891-4aad-89c8-e18eab21fe4b None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:41.128882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0bb6f-491f-4a6e-8b93-bdf3b0864a56 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:41.202083 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d0253-2dbb-4874-aa3e-0b9fa184356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:41.203198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d0253-2dbb-4874-aa3e-0b9fa184356e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:41.203779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d0253-2dbb-4874-aa3e-0b9fa184356e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:41.204363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d0253-2dbb-4874-aa3e-0b9fa184356e None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:41.205974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d0253-2dbb-4874-aa3e-0b9fa184356e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:41.207407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d0253-2dbb-4874-aa3e-0b9fa184356e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:41.210988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d0253-2dbb-4874-aa3e-0b9fa184356e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:41.242198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 310/615] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Aug 10 22:41:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:41.244007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777342d4-d89f-4e9f-9426-da8b954bcaa9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:41.244525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777342d4-d89f-4e9f-9426-da8b954bcaa9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:41.244989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777342d4-d89f-4e9f-9426-da8b954bcaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:41.250426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0ea7f-c891-4aad-89c8-e18eab21fe4b None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:41.265443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-777342d4-d89f-4e9f-9426-da8b954bcaa9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:41.266998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-777342d4-d89f-4e9f-9426-da8b954bcaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:41.307468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b4231-e75f-49ac-bc3a-3c8ddd13041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:41.308261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4231-e75f-49ac-bc3a-3c8ddd13041f None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:41.308606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4231-e75f-49ac-bc3a-3c8ddd13041f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:41.308931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b4231-e75f-49ac-bc3a-3c8ddd13041f None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/ff5c08bfc5e94b65bd4addde267e4598/roles/4287d802f16f48e99bde5dad08836906` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:41.339668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b4231-e75f-49ac-bc3a-3c8ddd13041f None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=ff5c08bfc5e94b65bd4addde267e4598, role_id=4287d802f16f48e99bde5dad08836906)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:41.341266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b4231-e75f-49ac-bc3a-3c8ddd13041f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:41.365343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 311/616] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:41.366925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777342d4-d89f-4e9f-9426-da8b954bcaa9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:41.419862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:41.491918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 306/617] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:41:41 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/ff5c08bfc5e94b65bd4addde267e4598/roles/4287d802f16f48e99bde5dad08836906 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:41.494029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b4231-e75f-49ac-bc3a-3c8ddd13041f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:41.677863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777342d4-d89f-4e9f-9426-da8b954bcaa9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:41.688815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:41.721506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cdb0b-cbcf-44d9-bf7c-f3a09a5a9a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:41.721506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cdb0b-cbcf-44d9-bf7c-f3a09a5a9a0b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:41.721506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cdb0b-cbcf-44d9-bf7c-f3a09a5a9a0b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:41.721506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cdb0b-cbcf-44d9-bf7c-f3a09a5a9a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:41.739998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cdb0b-cbcf-44d9-bf7c-f3a09a5a9a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:41.741507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cdb0b-cbcf-44d9-bf7c-f3a09a5a9a0b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:41.774598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b4231-e75f-49ac-bc3a-3c8ddd13041f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-722cdb0b-cbcf-44d9-bf7c-f3a09a5a9a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:41.775692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:41.777474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:41.779252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:41.779252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:41.779252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:41.779252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 312/618] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:41.786913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cdb0b-cbcf-44d9-bf7c-f3a09a5a9a0b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:41.825160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab614c91-f599-4109-86e3-63f501eb2594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:41.825845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab614c91-f599-4109-86e3-63f501eb2594 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:41.826634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab614c91-f599-4109-86e3-63f501eb2594 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:41.827009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab614c91-f599-4109-86e3-63f501eb2594 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:41.840029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab614c91-f599-4109-86e3-63f501eb2594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-ab614c91-f599-4109-86e3-63f501eb2594 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:41.845465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:41.847906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 307/619] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:41.851618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbc2a6-d7dc-44a3-bbc3-f8cdbef95db4 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:41.858658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbc2a6-d7dc-44a3-bbc3-f8cdbef95db4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:41.858658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbc2a6-d7dc-44a3-bbc3-f8cdbef95db4 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:41.858658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 308/620] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:41.867709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f63a8-ad2e-44fc-8751-dcbb5b00e0b9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:41.869353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f63a8-ad2e-44fc-8751-dcbb5b00e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:41.869353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f63a8-ad2e-44fc-8751-dcbb5b00e0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:41.886605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:41.895162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-634f63a8-ad2e-44fc-8751-dcbb5b00e0b9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:41.898032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-634f63a8-ad2e-44fc-8751-dcbb5b00e0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:41.907519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cdb0b-cbcf-44d9-bf7c-f3a09a5a9a0b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:41.965337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a946-b21e-4d6f-9cc8-04d6c56afe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:41.966273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a946-b21e-4d6f-9cc8-04d6c56afe80 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:41.966772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a946-b21e-4d6f-9cc8-04d6c56afe80 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:41.967239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a946-b21e-4d6f-9cc8-04d6c56afe80 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:41.968684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187a946-b21e-4d6f-9cc8-04d6c56afe80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:41.969011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187a946-b21e-4d6f-9cc8-04d6c56afe80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:41.971077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187a946-b21e-4d6f-9cc8-04d6c56afe80 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:41.995716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 313/621] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:41.996761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a946-b21e-4d6f-9cc8-04d6c56afe80 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:42.021488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 309/622] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:42.022604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f63a8-ad2e-44fc-8751-dcbb5b00e0b9 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:42.106018 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:42.161975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a946-b21e-4d6f-9cc8-04d6c56afe80 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:42.201380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f63a8-ad2e-44fc-8751-dcbb5b00e0b9 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:42.214751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f11e4f-13a6-479b-9e46-fd0c752a5d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:42.215826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11e4f-13a6-479b-9e46-fd0c752a5d18 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:42.216105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11e4f-13a6-479b-9e46-fd0c752a5d18 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:42.216378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11e4f-13a6-479b-9e46-fd0c752a5d18 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:42.217051 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f11e4f-13a6-479b-9e46-fd0c752a5d18 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:42.217399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f11e4f-13a6-479b-9e46-fd0c752a5d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:42.219145 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f11e4f-13a6-479b-9e46-fd0c752a5d18 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:42.235669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 314/623] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:42.236620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f11e4f-13a6-479b-9e46-fd0c752a5d18 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:42.241353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:42.256426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d172a-611e-4bbc-90d9-f3ec7a0f7f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:42.257555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d172a-611e-4bbc-90d9-f3ec7a0f7f41 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:42.258043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d172a-611e-4bbc-90d9-f3ec7a0f7f41 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:42.258526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d172a-611e-4bbc-90d9-f3ec7a0f7f41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:42.265993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d172a-611e-4bbc-90d9-f3ec7a0f7f41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:42.267738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d172a-611e-4bbc-90d9-f3ec7a0f7f41 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-f76d172a-611e-4bbc-90d9-f3ec7a0f7f41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:42.281721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:42.282665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:42.283571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:42.283571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:42.283571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:42.283571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:42.283571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:42.283571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:42.283571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:42.283571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:42.286148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 310/624] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:42.287424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d172a-611e-4bbc-90d9-f3ec7a0f7f41 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:42.495670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f11e4f-13a6-479b-9e46-fd0c752a5d18 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:42.495874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:42.495874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d172a-611e-4bbc-90d9-f3ec7a0f7f41 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:42.496214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d439c9b-f88c-4b30-97c9-748e141a022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:42.496214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d439c9b-f88c-4b30-97c9-748e141a022f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:42.496214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d439c9b-f88c-4b30-97c9-748e141a022f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:42.496214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d439c9b-f88c-4b30-97c9-748e141a022f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d439c9b-f88c-4b30-97c9-748e141a022f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-0d439c9b-f88c-4b30-97c9-748e141a022f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:42.496814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:42.498505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:42.500333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 315/625] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:42.502941 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d439c9b-f88c-4b30-97c9-748e141a022f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:42.503094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915634f0-3110-4f1e-92a4-d29a42593676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:42.503094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915634f0-3110-4f1e-92a4-d29a42593676 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:42.503094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915634f0-3110-4f1e-92a4-d29a42593676 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:42.503094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915634f0-3110-4f1e-92a4-d29a42593676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915634f0-3110-4f1e-92a4-d29a42593676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915634f0-3110-4f1e-92a4-d29a42593676 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-915634f0-3110-4f1e-92a4-d29a42593676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:42.503685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:42.505872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 311/626] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:42.509873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915634f0-3110-4f1e-92a4-d29a42593676 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:42.559697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d439c9b-f88c-4b30-97c9-748e141a022f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:42.609889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff36f2-a49d-460d-b07e-4c63ea87889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:42.612979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915634f0-3110-4f1e-92a4-d29a42593676 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:42.613728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:42.615178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff36f2-a49d-460d-b07e-4c63ea87889d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:42.615657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff36f2-a49d-460d-b07e-4c63ea87889d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:42.616331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff36f2-a49d-460d-b07e-4c63ea87889d None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:42.618581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff36f2-a49d-460d-b07e-4c63ea87889d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:42.619058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff36f2-a49d-460d-b07e-4c63ea87889d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:42.621423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff36f2-a49d-460d-b07e-4c63ea87889d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:42.644610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 316/627] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:42.645627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff36f2-a49d-460d-b07e-4c63ea87889d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:42.657750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283fa6-51a4-4aa2-a344-d227c42c211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:42.658351 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283fa6-51a4-4aa2-a344-d227c42c211c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:42.658651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283fa6-51a4-4aa2-a344-d227c42c211c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:42.658885 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283fa6-51a4-4aa2-a344-d227c42c211c None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:42.659539 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283fa6-51a4-4aa2-a344-d227c42c211c None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:42.659834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283fa6-51a4-4aa2-a344-d227c42c211c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:42.661214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283fa6-51a4-4aa2-a344-d227c42c211c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:42.669209 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 312/628] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:42.670441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddab88-a00c-4208-aec9-68a41e1f5691 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:42.670718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddab88-a00c-4208-aec9-68a41e1f5691 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:42.670986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddab88-a00c-4208-aec9-68a41e1f5691 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:42.676349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 313/629] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:42.676349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddab88-a00c-4208-aec9-68a41e1f5691 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:42.774716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff36f2-a49d-460d-b07e-4c63ea87889d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:42.806023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddab88-a00c-4208-aec9-68a41e1f5691 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:42.823780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e9a4a-40e9-4b81-ad34-834e35adda46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:42.824807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e9a4a-40e9-4b81-ad34-834e35adda46 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:42.825332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e9a4a-40e9-4b81-ad34-834e35adda46 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:42.825634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e9a4a-40e9-4b81-ad34-834e35adda46 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:42.826242 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e9a4a-40e9-4b81-ad34-834e35adda46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:42.826561 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e9a4a-40e9-4b81-ad34-834e35adda46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:42.828079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e9a4a-40e9-4b81-ad34-834e35adda46 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:42.845774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 317/630] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:42.845774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e9a4a-40e9-4b81-ad34-834e35adda46 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:42.852614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26787ef6-60c5-49af-8439-071e002cfa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:42.853348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787ef6-60c5-49af-8439-071e002cfa21 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:42.853724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787ef6-60c5-49af-8439-071e002cfa21 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:42.854158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787ef6-60c5-49af-8439-071e002cfa21 None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/6c892a519c8348728d43f0f0d447a321/roles/4287d802f16f48e99bde5dad08836906` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:42.867053 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:42.873951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26787ef6-60c5-49af-8439-071e002cfa21 None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=6c892a519c8348728d43f0f0d447a321, role_id=4287d802f16f48e99bde5dad08836906)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:42.875314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26787ef6-60c5-49af-8439-071e002cfa21 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:42.900266 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:42.945350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 314/631] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:41:42 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/6c892a519c8348728d43f0f0d447a321/roles/4287d802f16f48e99bde5dad08836906 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:41:42.945350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6eaad-2930-4610-a7b7-e912357bd773 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:42.945350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6eaad-2930-4610-a7b7-e912357bd773 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:42.945350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6eaad-2930-4610-a7b7-e912357bd773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:42.979562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-69d6eaad-2930-4610-a7b7-e912357bd773 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:42.982189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-69d6eaad-2930-4610-a7b7-e912357bd773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:43.005166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e9a4a-40e9-4b81-ad34-834e35adda46 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:43.073050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade706d-0ff7-4de4-96ac-524a37a0d336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:43.073890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade706d-0ff7-4de4-96ac-524a37a0d336 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:43.074334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade706d-0ff7-4de4-96ac-524a37a0d336 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:43.074763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade706d-0ff7-4de4-96ac-524a37a0d336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:43.077633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:43.094840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade706d-0ff7-4de4-96ac-524a37a0d336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:43.097519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade706d-0ff7-4de4-96ac-524a37a0d336 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:43.107492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 315/632] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:43.110112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6eaad-2930-4610-a7b7-e912357bd773 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-8ade706d-0ff7-4de4-96ac-524a37a0d336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:43.118318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:43.120600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:43.122604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:43.122604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:43.122604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:43.122604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 318/633] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:43.125751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade706d-0ff7-4de4-96ac-524a37a0d336 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:43.186250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:43.276421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6eaad-2930-4610-a7b7-e912357bd773 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:43.277655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade706d-0ff7-4de4-96ac-524a37a0d336 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:43.316719 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41663e1e-9e44-4bdf-b76f-e665014d17e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:43.320696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41663e1e-9e44-4bdf-b76f-e665014d17e4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:43.320696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41663e1e-9e44-4bdf-b76f-e665014d17e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:43.320696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41663e1e-9e44-4bdf-b76f-e665014d17e4 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:43.320696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41663e1e-9e44-4bdf-b76f-e665014d17e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:43.320696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41663e1e-9e44-4bdf-b76f-e665014d17e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:43.320696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41663e1e-9e44-4bdf-b76f-e665014d17e4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:43.321944 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b24a5-009b-428d-8d5a-dbcc9d6dbad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:43.323205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b24a5-009b-428d-8d5a-dbcc9d6dbad4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:43.323632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b24a5-009b-428d-8d5a-dbcc9d6dbad4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:43.324128 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b24a5-009b-428d-8d5a-dbcc9d6dbad4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:43.334577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b24a5-009b-428d-8d5a-dbcc9d6dbad4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:43.335733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 319/634] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:43.336554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b24a5-009b-428d-8d5a-dbcc9d6dbad4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:43.336924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41663e1e-9e44-4bdf-b76f-e665014d17e4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-6e4b24a5-009b-428d-8d5a-dbcc9d6dbad4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:43.353604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:43.354835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:43.355772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:43.355772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:43.355772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:43.355772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:43.355772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:43.355772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:43.355772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:43.355772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:43.355772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:41:43.355772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:43.358800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 316/635] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Aug 10 22:41:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:43.363840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b24a5-009b-428d-8d5a-dbcc9d6dbad4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:43.431332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:43.508625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:43.514485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b24a5-009b-428d-8d5a-dbcc9d6dbad4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:43.517927 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41663e1e-9e44-4bdf-b76f-e665014d17e4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:43.568443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4a7d3-a299-402f-8e4c-d93ca8f14644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:43.569080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4a7d3-a299-402f-8e4c-d93ca8f14644 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:43.569390 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4a7d3-a299-402f-8e4c-d93ca8f14644 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:43.569680 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4a7d3-a299-402f-8e4c-d93ca8f14644 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:43.578156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf0c61-bd19-4c6a-ad91-886f0f454f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:43.579246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf0c61-bd19-4c6a-ad91-886f0f454f42 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:43.579985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf0c61-bd19-4c6a-ad91-886f0f454f42 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:43.580618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf0c61-bd19-4c6a-ad91-886f0f454f42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:43.581562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4a7d3-a299-402f-8e4c-d93ca8f14644 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:43.584555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4a7d3-a299-402f-8e4c-d93ca8f14644 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:43.595136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf0c61-bd19-4c6a-ad91-886f0f454f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d5f4a7d3-a299-402f-8e4c-d93ca8f14644 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:43.597480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:43.598771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:43.599720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 317/636] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:43.600925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4a7d3-a299-402f-8e4c-d93ca8f14644 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-dccf0c61-bd19-4c6a-ad91-886f0f454f42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:43.607275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:43.608280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:43.609181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 320/637] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:43.612423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf0c61-bd19-4c6a-ad91-886f0f454f42 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:43.720717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4a7d3-a299-402f-8e4c-d93ca8f14644 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:43.730787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf0c61-bd19-4c6a-ad91-886f0f454f42 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:43.731611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:43.762800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0cb48-ac41-4659-9d65-2993cb5ba007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:43.763417 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0cb48-ac41-4659-9d65-2993cb5ba007 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:43.763830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0cb48-ac41-4659-9d65-2993cb5ba007 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:43.764054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0cb48-ac41-4659-9d65-2993cb5ba007 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:43.764689 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0cb48-ac41-4659-9d65-2993cb5ba007 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:43.766015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0cb48-ac41-4659-9d65-2993cb5ba007 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:43.768190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0cb48-ac41-4659-9d65-2993cb5ba007 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:43.775157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9bdb7-e85a-48f8-95b1-89c16243da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:43.776222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9bdb7-e85a-48f8-95b1-89c16243da25 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:43.776721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9bdb7-e85a-48f8-95b1-89c16243da25 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:43.777122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9bdb7-e85a-48f8-95b1-89c16243da25 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:43.778421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9bdb7-e85a-48f8-95b1-89c16243da25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:43.778968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9bdb7-e85a-48f8-95b1-89c16243da25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:43.781849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9bdb7-e85a-48f8-95b1-89c16243da25 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:43.799844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 318/638] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Aug 10 22:41:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:43.799844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0cb48-ac41-4659-9d65-2993cb5ba007 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:43.817638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 321/639] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Aug 10 22:41:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:43.819040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1d303-9aa0-4cbe-a92b-9aa543ade62a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:43.819331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1d303-9aa0-4cbe-a92b-9aa543ade62a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:43.819614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1d303-9aa0-4cbe-a92b-9aa543ade62a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:43.821201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 322/640] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:43.821720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1d303-9aa0-4cbe-a92b-9aa543ade62a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:43.844194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:43.940762 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0cb48-ac41-4659-9d65-2993cb5ba007 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:43.956358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1d303-9aa0-4cbe-a92b-9aa543ade62a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:43.983297 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827500-dc58-4d5e-abab-d0e610abfb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:43.984265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827500-dc58-4d5e-abab-d0e610abfb29 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:43.984604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827500-dc58-4d5e-abab-d0e610abfb29 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:43.984767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827500-dc58-4d5e-abab-d0e610abfb29 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:43.985458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83827500-dc58-4d5e-abab-d0e610abfb29 None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:43.985752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83827500-dc58-4d5e-abab-d0e610abfb29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:43.987128 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83827500-dc58-4d5e-abab-d0e610abfb29 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:44.001324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 319/641] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:44.001324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827500-dc58-4d5e-abab-d0e610abfb29 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:44.016150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2018ad-9fa0-4796-8b9b-7bcd8ebbd9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:44.017136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2018ad-9fa0-4796-8b9b-7bcd8ebbd9ec None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:44.017698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2018ad-9fa0-4796-8b9b-7bcd8ebbd9ec None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:44.018214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2018ad-9fa0-4796-8b9b-7bcd8ebbd9ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:44.033531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:44.122575 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2018ad-9fa0-4796-8b9b-7bcd8ebbd9ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:44.124980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2018ad-9fa0-4796-8b9b-7bcd8ebbd9ec None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:44.129183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827500-dc58-4d5e-abab-d0e610abfb29 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:44.151028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:44.171525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51a4da-a004-4239-8be5-7742d4827041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:44.172432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a4da-a004-4239-8be5-7742d4827041 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:44.172890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a4da-a004-4239-8be5-7742d4827041 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:44.173380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a4da-a004-4239-8be5-7742d4827041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:44.271413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51a4da-a004-4239-8be5-7742d4827041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:44.273584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51a4da-a004-4239-8be5-7742d4827041 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:44.291087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 323/642] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:44.292344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86cb00-f21f-47c3-b53c-d1227d412b2f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:44.292624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86cb00-f21f-47c3-b53c-d1227d412b2f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:44.292887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86cb00-f21f-47c3-b53c-d1227d412b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:44.317397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cb86cb00-f21f-47c3-b53c-d1227d412b2f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:44.318500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cb86cb00-f21f-47c3-b53c-d1227d412b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:44.325891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:44.425638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 320/643] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:44.425851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 324/644] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:44.426044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51a4da-a004-4239-8be5-7742d4827041 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:44.430765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86cb00-f21f-47c3-b53c-d1227d412b2f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:44.510164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:44.549935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51a4da-a004-4239-8be5-7742d4827041 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:44.588271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:44.601280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86cb00-f21f-47c3-b53c-d1227d412b2f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:44.607972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7d912-7953-46e3-bc15-72e8d7f387b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:44.607972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7d912-7953-46e3-bc15-72e8d7f387b3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:44.607972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7d912-7953-46e3-bc15-72e8d7f387b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:44.607972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7d912-7953-46e3-bc15-72e8d7f387b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:44.619207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7d912-7953-46e3-bc15-72e8d7f387b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:44.620648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7d912-7953-46e3-bc15-72e8d7f387b3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d5e7d912-7953-46e3-bc15-72e8d7f387b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:44.642009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:44.643105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:44.644849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:44.644849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:44.644849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:44.644849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 321/645] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:44.644849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7d912-7953-46e3-bc15-72e8d7f387b3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:44.650844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ca30d-8f21-42a4-8861-2ebd9a238037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:44.651499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ca30d-8f21-42a4-8861-2ebd9a238037 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:44.651779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ca30d-8f21-42a4-8861-2ebd9a238037 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:44.652060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ca30d-8f21-42a4-8861-2ebd9a238037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:44.668808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ca30d-8f21-42a4-8861-2ebd9a238037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:44.671669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ca30d-8f21-42a4-8861-2ebd9a238037 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6c7ca30d-8f21-42a4-8861-2ebd9a238037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:44.694977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:44.702052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:44.704182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:44.704182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:44.704182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:44.704182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 325/646] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:44.704182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ca30d-8f21-42a4-8861-2ebd9a238037 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:44.778867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7d912-7953-46e3-bc15-72e8d7f387b3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:44.820399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:44.825245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8ccf0-e261-423a-8aaf-ba182ffd8cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:44.825969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8ccf0-e261-423a-8aaf-ba182ffd8cca None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:44.826250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8ccf0-e261-423a-8aaf-ba182ffd8cca None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:44.826523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8ccf0-e261-423a-8aaf-ba182ffd8cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:44.826711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ca30d-8f21-42a4-8861-2ebd9a238037 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:44.839106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8ccf0-e261-423a-8aaf-ba182ffd8cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:44.840555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8ccf0-e261-423a-8aaf-ba182ffd8cca None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-fbf8ccf0-e261-423a-8aaf-ba182ffd8cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:44.859981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:44.860853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:44.860853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:44.860853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:44.860853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 322/647] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:44.860853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8ccf0-e261-423a-8aaf-ba182ffd8cca None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:44.879356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f7e7d-d83c-43d6-95b1-005acca8effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:44.880566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f7e7d-d83c-43d6-95b1-005acca8effe None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:44.880841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f7e7d-d83c-43d6-95b1-005acca8effe None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:44.881111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f7e7d-d83c-43d6-95b1-005acca8effe None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:44.894551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f7e7d-d83c-43d6-95b1-005acca8effe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a41f7e7d-d83c-43d6-95b1-005acca8effe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:44.900147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:44.902264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 326/648] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:44.904131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f7e7d-d83c-43d6-95b1-005acca8effe None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:44.914589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:45.012284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8ccf0-e261-423a-8aaf-ba182ffd8cca None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.050643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f7e7d-d83c-43d6-95b1-005acca8effe None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.057953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32d1f2-3d54-4d6e-80ef-398de010905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.058661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32d1f2-3d54-4d6e-80ef-398de010905c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.059000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32d1f2-3d54-4d6e-80ef-398de010905c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.059331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32d1f2-3d54-4d6e-80ef-398de010905c None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.060035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32d1f2-3d54-4d6e-80ef-398de010905c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:45.060395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32d1f2-3d54-4d6e-80ef-398de010905c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:45.061884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32d1f2-3d54-4d6e-80ef-398de010905c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:45.076188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 323/649] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:45.077052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32d1f2-3d54-4d6e-80ef-398de010905c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:45.120691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d5443-256b-485e-a837-8d50e023798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.122124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d5443-256b-485e-a837-8d50e023798e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.122872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d5443-256b-485e-a837-8d50e023798e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.123575 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d5443-256b-485e-a837-8d50e023798e None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.125039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d5443-256b-485e-a837-8d50e023798e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:45.125612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d5443-256b-485e-a837-8d50e023798e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:45.128258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d5443-256b-485e-a837-8d50e023798e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:45.145736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 327/650] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:45.146620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d5443-256b-485e-a837-8d50e023798e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:45.170028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:45.197568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:45.209222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32d1f2-3d54-4d6e-80ef-398de010905c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.254066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f757af-c1be-4d1c-8d4c-70fae4543c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.254731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f757af-c1be-4d1c-8d4c-70fae4543c79 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.255045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f757af-c1be-4d1c-8d4c-70fae4543c79 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.255254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f757af-c1be-4d1c-8d4c-70fae4543c79 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.255907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f757af-c1be-4d1c-8d4c-70fae4543c79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:45.256200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f757af-c1be-4d1c-8d4c-70fae4543c79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:45.257637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f757af-c1be-4d1c-8d4c-70fae4543c79 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:45.276645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 324/651] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:45.276645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f757af-c1be-4d1c-8d4c-70fae4543c79 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:45.281848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d5443-256b-485e-a837-8d50e023798e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.320773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a7994-0522-40e9-a07d-cd92ea52f60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.321433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a7994-0522-40e9-a07d-cd92ea52f60c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.321713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a7994-0522-40e9-a07d-cd92ea52f60c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.321985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a7994-0522-40e9-a07d-cd92ea52f60c None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.400786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a7994-0522-40e9-a07d-cd92ea52f60c None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:45.400786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a7994-0522-40e9-a07d-cd92ea52f60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:45.400786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a7994-0522-40e9-a07d-cd92ea52f60c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:45.400786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 328/652] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:45.400786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a7994-0522-40e9-a07d-cd92ea52f60c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:45.401488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f757af-c1be-4d1c-8d4c-70fae4543c79 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.419117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:45.434979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16c863-817c-4d99-91c7-5d5fa71d12bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.435609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c863-817c-4d99-91c7-5d5fa71d12bb None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.435881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c863-817c-4d99-91c7-5d5fa71d12bb None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.436148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c863-817c-4d99-91c7-5d5fa71d12bb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.442171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a7994-0522-40e9-a07d-cd92ea52f60c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.443976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16c863-817c-4d99-91c7-5d5fa71d12bb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:45.445459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16c863-817c-4d99-91c7-5d5fa71d12bb None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-dc16c863-817c-4d99-91c7-5d5fa71d12bb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:45.456654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:45.457683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:45.458612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:45.458612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:45.458612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:45.458612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:45.458612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:45.458612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:45.458612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:45.458612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:45.458612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 22:41:45.458612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:45.459825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 325/653] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:45.461044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c5749-d6fd-43d2-b5c8-aacac17fdbc4 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.461221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c5749-d6fd-43d2-b5c8-aacac17fdbc4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.461536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c5749-d6fd-43d2-b5c8-aacac17fdbc4 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.462781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 326/654] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:45.463939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c5749-d6fd-43d2-b5c8-aacac17fdbc4 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:45.478966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d64c6-1d77-44ed-93e3-c219b74ac22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.479734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d64c6-1d77-44ed-93e3-c219b74ac22f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.480085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d64c6-1d77-44ed-93e3-c219b74ac22f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.480360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d64c6-1d77-44ed-93e3-c219b74ac22f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.480645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:45.487538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d64c6-1d77-44ed-93e3-c219b74ac22f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:45.489932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d64c6-1d77-44ed-93e3-c219b74ac22f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-be2d64c6-1d77-44ed-93e3-c219b74ac22f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:45.503493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:45.504482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:45.505573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:45.505573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:45.505573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:45.505573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:45.505573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:45.505573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:45.505573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:45.505573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:45.505573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 329/655] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:45.506114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d64c6-1d77-44ed-93e3-c219b74ac22f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:45.579300 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c5749-d6fd-43d2-b5c8-aacac17fdbc4 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.614743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b2664-ec0a-4b96-8075-3680d0b0a839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.615496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b2664-ec0a-4b96-8075-3680d0b0a839 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.615654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b2664-ec0a-4b96-8075-3680d0b0a839 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.615919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b2664-ec0a-4b96-8075-3680d0b0a839 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.620511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d64c6-1d77-44ed-93e3-c219b74ac22f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.622626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b2664-ec0a-4b96-8075-3680d0b0a839 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:45.624096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b2664-ec0a-4b96-8075-3680d0b0a839 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-9a3b2664-ec0a-4b96-8075-3680d0b0a839 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:45.635606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:45.636649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:45.637562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:45.637562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:45.637562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:45.637562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:45.637562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:45.637562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:45.637562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:45.637562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:45.637562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 327/656] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:45.637562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b2664-ec0a-4b96-8075-3680d0b0a839 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:45.660395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34cf73-ea13-4a32-9118-2a05b71336d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.661623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34cf73-ea13-4a32-9118-2a05b71336d1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.661907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34cf73-ea13-4a32-9118-2a05b71336d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.662174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34cf73-ea13-4a32-9118-2a05b71336d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.668775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:45.674534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34cf73-ea13-4a32-9118-2a05b71336d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:45.676535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34cf73-ea13-4a32-9118-2a05b71336d1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-8d34cf73-ea13-4a32-9118-2a05b71336d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:45.690844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:45.691877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:45.692792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:45.692792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:45.692792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:45.692792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 330/657] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:45.693120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f7dd3-1ba9-433a-b81c-9189fb8735a4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.693407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f7dd3-1ba9-433a-b81c-9189fb8735a4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.693674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f7dd3-1ba9-433a-b81c-9189fb8735a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.712200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e80f7dd3-1ba9-433a-b81c-9189fb8735a4 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:45.713436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e80f7dd3-1ba9-433a-b81c-9189fb8735a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:45.726932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:45.743056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b2664-ec0a-4b96-8075-3680d0b0a839 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.779925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a710c26-4bcc-49a2-9bd3-6d5bcdcb03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.780533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710c26-4bcc-49a2-9bd3-6d5bcdcb03c3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.780814 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710c26-4bcc-49a2-9bd3-6d5bcdcb03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.781225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a710c26-4bcc-49a2-9bd3-6d5bcdcb03c3 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.782037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a710c26-4bcc-49a2-9bd3-6d5bcdcb03c3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:45.782334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a710c26-4bcc-49a2-9bd3-6d5bcdcb03c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:45.783829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a710c26-4bcc-49a2-9bd3-6d5bcdcb03c3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:45.798865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 331/658] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:45.800617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f7dd3-1ba9-433a-b81c-9189fb8735a4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:45.816118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 328/659] 10.222.0.77 () {56 vars in 1137 bytes} [Wed Aug 10 22:41:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:45.817418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a710c26-4bcc-49a2-9bd3-6d5bcdcb03c3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:45.931647 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f7dd3-1ba9-433a-b81c-9189fb8735a4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.952544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a710c26-4bcc-49a2-9bd3-6d5bcdcb03c3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:45.953947 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:45.969580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e94b5-73fa-4b5f-a3a9-151e85bc545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.970356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e94b5-73fa-4b5f-a3a9-151e85bc545d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:45.970632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e94b5-73fa-4b5f-a3a9-151e85bc545d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:45.970906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e94b5-73fa-4b5f-a3a9-151e85bc545d None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:45.971614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e94b5-73fa-4b5f-a3a9-151e85bc545d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:45.971990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e94b5-73fa-4b5f-a3a9-151e85bc545d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:45.974223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e94b5-73fa-4b5f-a3a9-151e85bc545d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:45.992360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 332/660] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:45.993565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e94b5-73fa-4b5f-a3a9-151e85bc545d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:45.999222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26412c5c-d925-4e05-b458-2174aa7e6f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:45.999996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412c5c-d925-4e05-b458-2174aa7e6f3c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:46.000122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412c5c-d925-4e05-b458-2174aa7e6f3c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:46.000425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26412c5c-d925-4e05-b458-2174aa7e6f3c None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:46.005165 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:46.006026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26412c5c-d925-4e05-b458-2174aa7e6f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:46.006198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26412c5c-d925-4e05-b458-2174aa7e6f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:46.007618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26412c5c-d925-4e05-b458-2174aa7e6f3c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:46.025335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 329/661] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:46.026196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26412c5c-d925-4e05-b458-2174aa7e6f3c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:46.123114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e94b5-73fa-4b5f-a3a9-151e85bc545d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:46.160572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779650c4-7a45-4e95-8a9e-d7ee5cff0e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:46.161207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779650c4-7a45-4e95-8a9e-d7ee5cff0e13 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:46.161496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779650c4-7a45-4e95-8a9e-d7ee5cff0e13 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:46.161682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26412c5c-d925-4e05-b458-2174aa7e6f3c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:46.161871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779650c4-7a45-4e95-8a9e-d7ee5cff0e13 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:46.162405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779650c4-7a45-4e95-8a9e-d7ee5cff0e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:46.162703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779650c4-7a45-4e95-8a9e-d7ee5cff0e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:46.164106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779650c4-7a45-4e95-8a9e-d7ee5cff0e13 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:46.177613 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 333/662] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:46.178489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779650c4-7a45-4e95-8a9e-d7ee5cff0e13 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:46.206938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30c700-d2e4-4851-8f02-644ed760d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:46.208151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30c700-d2e4-4851-8f02-644ed760d101 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:46.208151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30c700-d2e4-4851-8f02-644ed760d101 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:46.208527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30c700-d2e4-4851-8f02-644ed760d101 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:46.222194 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30c700-d2e4-4851-8f02-644ed760d101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5b30c700-d2e4-4851-8f02-644ed760d101 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:46.228448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:46.230180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:46.231677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:46.232880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:46.233024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 330/663] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:46.233024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30c700-d2e4-4851-8f02-644ed760d101 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:46.301436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:46.334623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779650c4-7a45-4e95-8a9e-d7ee5cff0e13 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:46.358529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30c700-d2e4-4851-8f02-644ed760d101 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:46.380591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b02c5-da49-4e47-81cf-25e0b3ea3d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:46.381130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b02c5-da49-4e47-81cf-25e0b3ea3d4e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:46.381460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b02c5-da49-4e47-81cf-25e0b3ea3d4e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:46.381694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b02c5-da49-4e47-81cf-25e0b3ea3d4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:46.401453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb1771-6dba-4fc2-890e-e786ef8534a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:46.402413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb1771-6dba-4fc2-890e-e786ef8534a9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:46.402868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb1771-6dba-4fc2-890e-e786ef8534a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:46.403318 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb1771-6dba-4fc2-890e-e786ef8534a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:46.404610 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb1771-6dba-4fc2-890e-e786ef8534a9 None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=34568b830fc641edab39324047368546) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:46.405124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb1771-6dba-4fc2-890e-e786ef8534a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:46.407725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb1771-6dba-4fc2-890e-e786ef8534a9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:46.418816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 331/664] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:46 2022] GET /identity/v3/role_assignments?user.id=34568b830fc641edab39324047368546&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:46.420103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb1771-6dba-4fc2-890e-e786ef8534a9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:46.474157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b02c5-da49-4e47-81cf-25e0b3ea3d4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:46.476305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b02c5-da49-4e47-81cf-25e0b3ea3d4e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:46.548144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:46.600534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb1771-6dba-4fc2-890e-e786ef8534a9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:46.622732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:46.647273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ddff7-3099-4652-8d96-dd2a864bab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:46.648084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ddff7-3099-4652-8d96-dd2a864bab0c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:46.648546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ddff7-3099-4652-8d96-dd2a864bab0c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:46.648991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ddff7-3099-4652-8d96-dd2a864bab0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:46.650393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ddff7-3099-4652-8d96-dd2a864bab0c None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=6e86be85010d4851a1ce3381832af230) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:46.650920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ddff7-3099-4652-8d96-dd2a864bab0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:46.653411 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ddff7-3099-4652-8d96-dd2a864bab0c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:46.654370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 334/665] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:46.655894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b02c5-da49-4e47-81cf-25e0b3ea3d4e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:46.664445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 332/666] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:46 2022] GET /identity/v3/role_assignments?user.id=6e86be85010d4851a1ce3381832af230&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:46.665449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ddff7-3099-4652-8d96-dd2a864bab0c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:46.828967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ddff7-3099-4652-8d96-dd2a864bab0c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:46.857132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b02c5-da49-4e47-81cf-25e0b3ea3d4e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:46.889130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1409ee-da4e-4661-a634-973bd8a04af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:46.890153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1409ee-da4e-4661-a634-973bd8a04af3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:46.890641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1409ee-da4e-4661-a634-973bd8a04af3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:46.891097 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1409ee-da4e-4661-a634-973bd8a04af3 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:46.892223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1409ee-da4e-4661-a634-973bd8a04af3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:46.892751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1409ee-da4e-4661-a634-973bd8a04af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:46.897572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1409ee-da4e-4661-a634-973bd8a04af3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:46.913158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 333/667] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:46.914015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1409ee-da4e-4661-a634-973bd8a04af3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:46.923604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd45c66-1f0e-4fcd-9b02-bf894e3cdbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:46.924259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd45c66-1f0e-4fcd-9b02-bf894e3cdbaf None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:46.924535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd45c66-1f0e-4fcd-9b02-bf894e3cdbaf None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:46.924809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd45c66-1f0e-4fcd-9b02-bf894e3cdbaf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:46.945500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd45c66-1f0e-4fcd-9b02-bf894e3cdbaf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:46.947044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd45c66-1f0e-4fcd-9b02-bf894e3cdbaf None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:46.951044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-7bd45c66-1f0e-4fcd-9b02-bf894e3cdbaf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:46.966745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:46.974524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 335/668] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:46.975706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd45c66-1f0e-4fcd-9b02-bf894e3cdbaf None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:46.978369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:47.072775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1409ee-da4e-4661-a634-973bd8a04af3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:47.117756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cbf57-5831-4fe1-973e-f499a0c1c235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:47.118391 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cbf57-5831-4fe1-973e-f499a0c1c235 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:47.118660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cbf57-5831-4fe1-973e-f499a0c1c235 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:47.118929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cbf57-5831-4fe1-973e-f499a0c1c235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:47.133982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cbf57-5831-4fe1-973e-f499a0c1c235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:47.136149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cbf57-5831-4fe1-973e-f499a0c1c235 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5a8cbf57-5831-4fe1-973e-f499a0c1c235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:47.155206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:47.162404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:47.164036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:47.164036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:47.164036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:47.164036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 334/669] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:47.164036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cbf57-5831-4fe1-973e-f499a0c1c235 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:47.167430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd45c66-1f0e-4fcd-9b02-bf894e3cdbaf None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:47.233856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da4a4c-89cc-4bf1-8785-eaeb93c24caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:47.235371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da4a4c-89cc-4bf1-8785-eaeb93c24caa None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:47.236083 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da4a4c-89cc-4bf1-8785-eaeb93c24caa None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:47.236678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da4a4c-89cc-4bf1-8785-eaeb93c24caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:47.253322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da4a4c-89cc-4bf1-8785-eaeb93c24caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:47.256354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da4a4c-89cc-4bf1-8785-eaeb93c24caa None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a2da4a4c-89cc-4bf1-8785-eaeb93c24caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:47.278078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:47.279100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:47.279987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:47.279987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:47.279987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:47.287680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 336/670] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:47.289105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da4a4c-89cc-4bf1-8785-eaeb93c24caa None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:47.369314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:47.406161 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:47.418414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cbf57-5831-4fe1-973e-f499a0c1c235 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:47.432935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da4a4c-89cc-4bf1-8785-eaeb93c24caa None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:47.475505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eafcb2-13d8-49da-ab4b-f6c23fa482c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:47.475732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe39674-1673-4a1e-b7dc-a75ab95a9631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:47.476116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eafcb2-13d8-49da-ab4b-f6c23fa482c6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:47.476392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eafcb2-13d8-49da-ab4b-f6c23fa482c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:47.476507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe39674-1673-4a1e-b7dc-a75ab95a9631 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:47.476662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eafcb2-13d8-49da-ab4b-f6c23fa482c6 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:47.476864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe39674-1673-4a1e-b7dc-a75ab95a9631 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:47.477323 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe39674-1673-4a1e-b7dc-a75ab95a9631 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:47.477436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eafcb2-13d8-49da-ab4b-f6c23fa482c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:47.477664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eafcb2-13d8-49da-ab4b-f6c23fa482c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:47.478578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe39674-1673-4a1e-b7dc-a75ab95a9631 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:47.479043 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eafcb2-13d8-49da-ab4b-f6c23fa482c6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:47.479148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe39674-1673-4a1e-b7dc-a75ab95a9631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:47.481515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe39674-1673-4a1e-b7dc-a75ab95a9631 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:47.493467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 337/671] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:47.494336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eafcb2-13d8-49da-ab4b-f6c23fa482c6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:47.513629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 335/672] 10.222.0.77 () {56 vars in 1139 bytes} [Wed Aug 10 22:41:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:47.515013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe39674-1673-4a1e-b7dc-a75ab95a9631 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:47.667431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe39674-1673-4a1e-b7dc-a75ab95a9631 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:47.678806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eafcb2-13d8-49da-ab4b-f6c23fa482c6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:47.703736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:47.714821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874812d-1a73-485e-af7a-cc96a91600ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:47.716009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874812d-1a73-485e-af7a-cc96a91600ae None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:47.716508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874812d-1a73-485e-af7a-cc96a91600ae None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:47.719687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874812d-1a73-485e-af7a-cc96a91600ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:47.733230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874812d-1a73-485e-af7a-cc96a91600ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:47.736615 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874812d-1a73-485e-af7a-cc96a91600ae None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:47.737371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b410-a40e-43de-84e8-35d2f9ee3bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:47.738428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b410-a40e-43de-84e8-35d2f9ee3bfa None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:47.738987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b410-a40e-43de-84e8-35d2f9ee3bfa None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:47.739556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b410-a40e-43de-84e8-35d2f9ee3bfa None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:47.740974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23b410-a40e-43de-84e8-35d2f9ee3bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:47.742657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23b410-a40e-43de-84e8-35d2f9ee3bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:47.744194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23b410-a40e-43de-84e8-35d2f9ee3bfa None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-f874812d-1a73-485e-af7a-cc96a91600ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:47.761168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:47.763340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:47.765532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:47.765532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:47.765532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:47.765532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:47.765532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:47.765532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:47.765532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:47.765532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:47.766496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 338/673] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:47.766496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b410-a40e-43de-84e8-35d2f9ee3bfa None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:47.773339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 336/674] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:47.773339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874812d-1a73-485e-af7a-cc96a91600ae None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:47.801445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:47.902550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b410-a40e-43de-84e8-35d2f9ee3bfa None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:47.956767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca9694-a10c-4e7d-b4e4-939426c70293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:47.957115 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874812d-1a73-485e-af7a-cc96a91600ae None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:47.957753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca9694-a10c-4e7d-b4e4-939426c70293 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:47.958206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca9694-a10c-4e7d-b4e4-939426c70293 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:47.958884 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca9694-a10c-4e7d-b4e4-939426c70293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:48.011410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c37ac-51a8-44cd-9903-c35c2c940c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:48.012330 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c37ac-51a8-44cd-9903-c35c2c940c0c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:48.012617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c37ac-51a8-44cd-9903-c35c2c940c0c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:48.012887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c37ac-51a8-44cd-9903-c35c2c940c0c None admin] PATH_INFO: `/v3/users/swift` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:48.024341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c37ac-51a8-44cd-9903-c35c2c940c0c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:48.026470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c37ac-51a8-44cd-9903-c35c2c940c0c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-cf3c37ac-51a8-44cd-9903-c35c2c940c0c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:48.042918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:48.045214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 337/675] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:41:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:48.047507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c37ac-51a8-44cd-9903-c35c2c940c0c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:48.053788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:48.095646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca9694-a10c-4e7d-b4e4-939426c70293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:48.098528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca9694-a10c-4e7d-b4e4-939426c70293 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:48.173706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:48.191771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c37ac-51a8-44cd-9903-c35c2c940c0c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:48.243470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42c525-e348-4201-9858-154410bfdcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:48.244483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42c525-e348-4201-9858-154410bfdcb0 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:48.244970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42c525-e348-4201-9858-154410bfdcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:48.245469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42c525-e348-4201-9858-154410bfdcb0 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:48.246385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42c525-e348-4201-9858-154410bfdcb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:48.246908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42c525-e348-4201-9858-154410bfdcb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:48.248540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42c525-e348-4201-9858-154410bfdcb0 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:48.253438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 339/676] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:48.253438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca9694-a10c-4e7d-b4e4-939426c70293 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:48.269000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 338/677] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:48.270890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42c525-e348-4201-9858-154410bfdcb0 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:48.344775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:48.383977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca9694-a10c-4e7d-b4e4-939426c70293 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:48.401833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42c525-e348-4201-9858-154410bfdcb0 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:48.425002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34713f-ab12-4440-8875-e05bfc10775d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:48.425653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34713f-ab12-4440-8875-e05bfc10775d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:48.425924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34713f-ab12-4440-8875-e05bfc10775d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:48.426188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34713f-ab12-4440-8875-e05bfc10775d None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:48.427052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34713f-ab12-4440-8875-e05bfc10775d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:48.427346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34713f-ab12-4440-8875-e05bfc10775d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:48.428968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34713f-ab12-4440-8875-e05bfc10775d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:48.435594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:48.443011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d492456-e109-4d13-a29d-053c306b4486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:48.443980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d492456-e109-4d13-a29d-053c306b4486 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:48.444471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d492456-e109-4d13-a29d-053c306b4486 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:48.444965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d492456-e109-4d13-a29d-053c306b4486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:48.491631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 340/678] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Aug 10 22:41:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:48.491631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34713f-ab12-4440-8875-e05bfc10775d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d492456-e109-4d13-a29d-053c306b4486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d492456-e109-4d13-a29d-053c306b4486 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-1d492456-e109-4d13-a29d-053c306b4486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:48.491850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:48.492493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 339/679] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:48.493406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d492456-e109-4d13-a29d-053c306b4486 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:48.572217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34713f-ab12-4440-8875-e05bfc10775d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:48.604305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d492456-e109-4d13-a29d-053c306b4486 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:48.609054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:48.617534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305d85-4a58-4c56-92fe-b824aa9911f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:48.618199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305d85-4a58-4c56-92fe-b824aa9911f7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:48.618501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305d85-4a58-4c56-92fe-b824aa9911f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:48.619074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305d85-4a58-4c56-92fe-b824aa9911f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:48.619485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305d85-4a58-4c56-92fe-b824aa9911f7 None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=3eca4101d5a74563855c7fa3dcf1ccc0) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:48.619813 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305d85-4a58-4c56-92fe-b824aa9911f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:48.627343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305d85-4a58-4c56-92fe-b824aa9911f7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:48.637745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 341/680] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:48 2022] GET /identity/v3/role_assignments?user.id=3eca4101d5a74563855c7fa3dcf1ccc0&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:48.638762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305d85-4a58-4c56-92fe-b824aa9911f7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:48.658969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ecd07-e451-4600-b6e8-28d506408b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:48.660307 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ecd07-e451-4600-b6e8-28d506408b1a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:48.660997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ecd07-e451-4600-b6e8-28d506408b1a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:48.661773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ecd07-e451-4600-b6e8-28d506408b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:48.770504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:48.798806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ecd07-e451-4600-b6e8-28d506408b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:48.800720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ecd07-e451-4600-b6e8-28d506408b1a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:48.841628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305d85-4a58-4c56-92fe-b824aa9911f7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:48.885262 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0e702-0ccf-4c37-be29-e644f11fc727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:48.885902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e702-0ccf-4c37-be29-e644f11fc727 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:48.886181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e702-0ccf-4c37-be29-e644f11fc727 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:48.886448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e702-0ccf-4c37-be29-e644f11fc727 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:48.887086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0e702-0ccf-4c37-be29-e644f11fc727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:48.887380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0e702-0ccf-4c37-be29-e644f11fc727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:48.888764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0e702-0ccf-4c37-be29-e644f11fc727 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:48.905497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 342/681] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:48.905733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccac2d-d204-4326-9454-ac88e58f3b5b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:48.906015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccac2d-d204-4326-9454-ac88e58f3b5b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:48.906286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccac2d-d204-4326-9454-ac88e58f3b5b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:48.907740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 343/682] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:48.912767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccac2d-d204-4326-9454-ac88e58f3b5b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:48.927339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 340/683] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:48.928736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ad99-ebbb-4624-bf1e-a1b31161e100 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:48.929057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ad99-ebbb-4624-bf1e-a1b31161e100 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:48.929497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ad99-ebbb-4624-bf1e-a1b31161e100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:48.954497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-8da8ad99-ebbb-4624-bf1e-a1b31161e100 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:48.955728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8da8ad99-ebbb-4624-bf1e-a1b31161e100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:48.999964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:49.079505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccac2d-d204-4326-9454-ac88e58f3b5b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:49.085939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 341/684] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:49.085939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8ad99-ebbb-4624-bf1e-a1b31161e100 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:49.127747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:49.133743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7d521-c6dc-4919-a2e0-885127a3017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:49.134311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d521-c6dc-4919-a2e0-885127a3017e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:49.134588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d521-c6dc-4919-a2e0-885127a3017e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:49.134861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d521-c6dc-4919-a2e0-885127a3017e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:49.143312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7d521-c6dc-4919-a2e0-885127a3017e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:49.146143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7d521-c6dc-4919-a2e0-885127a3017e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-aea7d521-c6dc-4919-a2e0-885127a3017e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:49.167255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:49.168207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:49.169082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:49.169082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:49.169082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:49.169082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:49.169082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:49.169082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:49.169082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:49.169082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:49.170125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 344/685] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:49.171738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabddec-532c-4eb3-af3c-c45d846ac2ba None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:49.172278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabddec-532c-4eb3-af3c-c45d846ac2ba None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:49.172753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabddec-532c-4eb3-af3c-c45d846ac2ba None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:49.175392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 345/686] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:49.177359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabddec-532c-4eb3-af3c-c45d846ac2ba None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:49.250295 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8ad99-ebbb-4624-bf1e-a1b31161e100 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:49.299714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a19b0-4d58-4e85-855a-7d6ab6111aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:49.300767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a19b0-4d58-4e85-855a-7d6ab6111aa8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:49.301163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a19b0-4d58-4e85-855a-7d6ab6111aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:49.302460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a19b0-4d58-4e85-855a-7d6ab6111aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:49.306263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabddec-532c-4eb3-af3c-c45d846ac2ba None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:49.324967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:49.328280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a19b0-4d58-4e85-855a-7d6ab6111aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:49.330564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a19b0-4d58-4e85-855a-7d6ab6111aa8 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:49.352413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79df52-530e-490f-a53e-1931f89aba06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:49.353269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79df52-530e-490f-a53e-1931f89aba06 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:49.353583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79df52-530e-490f-a53e-1931f89aba06 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-ff5a19b0-4d58-4e85-855a-7d6ab6111aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:49.358280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:49.359984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:49.361789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:49.361789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:49.361789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:49.362188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79df52-530e-490f-a53e-1931f89aba06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:49.362336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 342/687] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:49.362336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a19b0-4d58-4e85-855a-7d6ab6111aa8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:49.367797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79df52-530e-490f-a53e-1931f89aba06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-3d79df52-530e-490f-a53e-1931f89aba06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:49.372723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:49.374205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 346/688] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:49.376533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66d5e-baab-42be-abd2-9f958e750ef4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:49.381648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66d5e-baab-42be-abd2-9f958e750ef4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:49.381648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f66d5e-baab-42be-abd2-9f958e750ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:49.403770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-39f66d5e-baab-42be-abd2-9f958e750ef4 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:49.405439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-39f66d5e-baab-42be-abd2-9f958e750ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:49.459124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:49.490662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 347/689] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:49.493621 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f66d5e-baab-42be-abd2-9f958e750ef4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:49.511255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a19b0-4d58-4e85-855a-7d6ab6111aa8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:49.558517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76409e92-5444-436c-b440-b1f5eff30a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:49.559132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76409e92-5444-436c-b440-b1f5eff30a72 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:49.574777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76409e92-5444-436c-b440-b1f5eff30a72 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:49.574777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76409e92-5444-436c-b440-b1f5eff30a72 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:49.574777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76409e92-5444-436c-b440-b1f5eff30a72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:49.574777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76409e92-5444-436c-b440-b1f5eff30a72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:49.574777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76409e92-5444-436c-b440-b1f5eff30a72 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:49.575415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 343/690] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:49.576419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76409e92-5444-436c-b440-b1f5eff30a72 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:49.643641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f66d5e-baab-42be-abd2-9f958e750ef4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:49.646756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:49.680176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7283b-3736-4427-8385-92c678e78fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:49.680777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7283b-3736-4427-8385-92c678e78fa0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:49.681059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7283b-3736-4427-8385-92c678e78fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:49.681357 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7283b-3736-4427-8385-92c678e78fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:49.682008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7283b-3736-4427-8385-92c678e78fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:49.682307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7283b-3736-4427-8385-92c678e78fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:49.683676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7283b-3736-4427-8385-92c678e78fa0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:49.695872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 348/691] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:49.696689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7283b-3736-4427-8385-92c678e78fa0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:49.702746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76409e92-5444-436c-b440-b1f5eff30a72 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:49.735033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:49.746737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2d2a3-97e7-45b1-b3b0-aa64e633e03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:49.748789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2d2a3-97e7-45b1-b3b0-aa64e633e03a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:49.748789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2d2a3-97e7-45b1-b3b0-aa64e633e03a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:49.748789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2d2a3-97e7-45b1-b3b0-aa64e633e03a None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:49.749324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2d2a3-97e7-45b1-b3b0-aa64e633e03a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:49.749764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2d2a3-97e7-45b1-b3b0-aa64e633e03a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:49.751278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2d2a3-97e7-45b1-b3b0-aa64e633e03a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:49.760747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 344/692] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:49.761631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2d2a3-97e7-45b1-b3b0-aa64e633e03a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:49.829545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7283b-3736-4427-8385-92c678e78fa0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:49.875510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c2074-5736-4d8d-9ab4-658426d70698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:49.876108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c2074-5736-4d8d-9ab4-658426d70698 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:49.876325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c2074-5736-4d8d-9ab4-658426d70698 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:49.876583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c2074-5736-4d8d-9ab4-658426d70698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:49.890299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2d2a3-97e7-45b1-b3b0-aa64e633e03a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:49.929439 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f08729-4325-46f9-9312-9b5bd72c993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:49.929790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f08729-4325-46f9-9312-9b5bd72c993c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:49.929993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f08729-4325-46f9-9312-9b5bd72c993c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:49.930271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f08729-4325-46f9-9312-9b5bd72c993c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:49.930987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f08729-4325-46f9-9312-9b5bd72c993c None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=ff5c08bfc5e94b65bd4addde267e4598) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:49.931290 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f08729-4325-46f9-9312-9b5bd72c993c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:49.932745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f08729-4325-46f9-9312-9b5bd72c993c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:49.949703 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 345/693] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:49 2022] GET /identity/v3/role_assignments?user.id=ff5c08bfc5e94b65bd4addde267e4598&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:49.949703 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f08729-4325-46f9-9312-9b5bd72c993c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:50.010497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c2074-5736-4d8d-9ab4-658426d70698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:50.012208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c2074-5736-4d8d-9ab4-658426d70698 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:50.023337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a55c2074-5736-4d8d-9ab4-658426d70698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:50.031961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:50.035686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:50.036563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:50.036563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:50.036563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:50.038737 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 349/694] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:50.039736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c2074-5736-4d8d-9ab4-658426d70698 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:50.062198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:50.099052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f08729-4325-46f9-9312-9b5bd72c993c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:50.144906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe089-b7cb-4c2f-98ba-d0483e18aabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:50.146699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe089-b7cb-4c2f-98ba-d0483e18aabf None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:50.146976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe089-b7cb-4c2f-98ba-d0483e18aabf None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:50.147252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fe089-b7cb-4c2f-98ba-d0483e18aabf None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:50.155743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fe089-b7cb-4c2f-98ba-d0483e18aabf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:50.157542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fe089-b7cb-4c2f-98ba-d0483e18aabf None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:50.167049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c2074-5736-4d8d-9ab4-658426d70698 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-9a6fe089-b7cb-4c2f-98ba-d0483e18aabf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:50.170497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:50.171398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:50.172299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:50.172299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:50.172299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:50.172299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:50.172299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:50.172299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:50.172299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:50.172299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:50.172299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 346/695] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:50.172802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe089-b7cb-4c2f-98ba-d0483e18aabf None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:50.213847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415269f-b326-440d-9208-06f3f9a939b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:50.215135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415269f-b326-440d-9208-06f3f9a939b2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:50.215135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415269f-b326-440d-9208-06f3f9a939b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:50.215135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415269f-b326-440d-9208-06f3f9a939b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:50.230479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415269f-b326-440d-9208-06f3f9a939b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:50.231923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415269f-b326-440d-9208-06f3f9a939b2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5415269f-b326-440d-9208-06f3f9a939b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:50.247974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:50.248961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:50.249896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:50.249896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:50.249896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:50.249896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 350/696] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:50.250691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415269f-b326-440d-9208-06f3f9a939b2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:50.292960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fe089-b7cb-4c2f-98ba-d0483e18aabf None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:50.306076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:50.325171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:50.332673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe1025-9f28-4d2c-9d66-00d78103e088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:50.333311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe1025-9f28-4d2c-9d66-00d78103e088 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:50.333649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe1025-9f28-4d2c-9d66-00d78103e088 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:50.333947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe1025-9f28-4d2c-9d66-00d78103e088 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:50.334651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe1025-9f28-4d2c-9d66-00d78103e088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:50.334954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe1025-9f28-4d2c-9d66-00d78103e088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:50.336329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe1025-9f28-4d2c-9d66-00d78103e088 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:50.349484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 347/697] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:50.354325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe1025-9f28-4d2c-9d66-00d78103e088 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:50.371598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415269f-b326-440d-9208-06f3f9a939b2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:50.409824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426064-e020-4652-8c74-dce36893c16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:50.410432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426064-e020-4652-8c74-dce36893c16c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:50.410748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426064-e020-4652-8c74-dce36893c16c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:50.411017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426064-e020-4652-8c74-dce36893c16c None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:50.411707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56426064-e020-4652-8c74-dce36893c16c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:50.412020 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56426064-e020-4652-8c74-dce36893c16c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:50.414084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56426064-e020-4652-8c74-dce36893c16c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:50.431487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 351/698] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:50.432588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426064-e020-4652-8c74-dce36893c16c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:50.469416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe1025-9f28-4d2c-9d66-00d78103e088 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:50.515469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079551ce-dc12-4335-ae1b-5c4bfbcdf26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:50.516177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079551ce-dc12-4335-ae1b-5c4bfbcdf26b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:50.516545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079551ce-dc12-4335-ae1b-5c4bfbcdf26b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:50.516862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079551ce-dc12-4335-ae1b-5c4bfbcdf26b None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:50.517601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079551ce-dc12-4335-ae1b-5c4bfbcdf26b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:50.517972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079551ce-dc12-4335-ae1b-5c4bfbcdf26b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:50.519450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079551ce-dc12-4335-ae1b-5c4bfbcdf26b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:50.533125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 348/699] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:50.534162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079551ce-dc12-4335-ae1b-5c4bfbcdf26b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:50.569708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426064-e020-4652-8c74-dce36893c16c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:50.574344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:50.614948 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:50.635090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d96f7-482b-4461-8a39-a50dd6354bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:50.636437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d96f7-482b-4461-8a39-a50dd6354bb5 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:50.637169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d96f7-482b-4461-8a39-a50dd6354bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:50.637689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d96f7-482b-4461-8a39-a50dd6354bb5 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:50.638748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d96f7-482b-4461-8a39-a50dd6354bb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:50.641078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d96f7-482b-4461-8a39-a50dd6354bb5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:50.658512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079551ce-dc12-4335-ae1b-5c4bfbcdf26b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:50.694493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d942a-8b20-457c-8a00-e4c1ead53a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:50.695190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d942a-8b20-457c-8a00-e4c1ead53a34 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:50.695532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d942a-8b20-457c-8a00-e4c1ead53a34 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:50.695884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d942a-8b20-457c-8a00-e4c1ead53a34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:50.696679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d942a-8b20-457c-8a00-e4c1ead53a34 None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=6c892a519c8348728d43f0f0d447a321) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:50.697042 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d942a-8b20-457c-8a00-e4c1ead53a34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:50.698585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d942a-8b20-457c-8a00-e4c1ead53a34 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:50.710299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 349/700] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:50 2022] GET /identity/v3/role_assignments?user.id=6c892a519c8348728d43f0f0d447a321&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:50.710299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d942a-8b20-457c-8a00-e4c1ead53a34 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:50.741970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 352/701] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:41:50 2022] POST /identity/v3/users => generated 254 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:41:50.859918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:50.870130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d942a-8b20-457c-8a00-e4c1ead53a34 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:50.919393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadaa7b-0089-48b4-b1cf-49cf694f69bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:50.920221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadaa7b-0089-48b4-b1cf-49cf694f69bf None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:50.920597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadaa7b-0089-48b4-b1cf-49cf694f69bf None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:50.920964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadaa7b-0089-48b4-b1cf-49cf694f69bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:50.930931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadaa7b-0089-48b4-b1cf-49cf694f69bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:50.932668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadaa7b-0089-48b4-b1cf-49cf694f69bf None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-eeadaa7b-0089-48b4-b1cf-49cf694f69bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:50.945333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:50.946498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:50.947636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:50.947636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:50.947636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:50.947636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:50.947636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:50.947636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:50.947636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:50.947636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:50.947636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:41:50.947636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:50.949468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 350/702] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Aug 10 22:41:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:50.949582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b2b5-bb8f-41be-a490-5844e4cf3bac None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:50.949831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b2b5-bb8f-41be-a490-5844e4cf3bac None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:50.950030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b2b5-bb8f-41be-a490-5844e4cf3bac None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:50.951584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 353/703] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:50.954985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadaa7b-0089-48b4-b1cf-49cf694f69bf None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:50.958687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7efc9-27a9-40e6-b16f-f2fffb7cdad9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:50.958965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7efc9-27a9-40e6-b16f-f2fffb7cdad9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:50.959351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7efc9-27a9-40e6-b16f-f2fffb7cdad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:50.986177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b3e7efc9-27a9-40e6-b16f-f2fffb7cdad9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:50.987393 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b3e7efc9-27a9-40e6-b16f-f2fffb7cdad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:51.070332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 354/704] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:51.078722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadaa7b-0089-48b4-b1cf-49cf694f69bf None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:51.094432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7efc9-27a9-40e6-b16f-f2fffb7cdad9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:51.117665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c615f9-31b3-4722-b8bf-14b287b6f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:51.118322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c615f9-31b3-4722-b8bf-14b287b6f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:51.118596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c615f9-31b3-4722-b8bf-14b287b6f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:51.118859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c615f9-31b3-4722-b8bf-14b287b6f5a0 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:51.119587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c615f9-31b3-4722-b8bf-14b287b6f5a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:51.119881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c615f9-31b3-4722-b8bf-14b287b6f5a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:51.121317 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c615f9-31b3-4722-b8bf-14b287b6f5a0 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:51.141399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 351/705] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Aug 10 22:41:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:51.148631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c615f9-31b3-4722-b8bf-14b287b6f5a0 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:51.173693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:51.220331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7efc9-27a9-40e6-b16f-f2fffb7cdad9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:51.248418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:51.264005 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c615f9-31b3-4722-b8bf-14b287b6f5a0 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:51.298138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd86e1d-58a6-4fe7-b363-30e5c38e99f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:51.298865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd86e1d-58a6-4fe7-b363-30e5c38e99f7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:51.299177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd86e1d-58a6-4fe7-b363-30e5c38e99f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:51.299508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd86e1d-58a6-4fe7-b363-30e5c38e99f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:51.300103 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd86e1d-58a6-4fe7-b363-30e5c38e99f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:51.301714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd86e1d-58a6-4fe7-b363-30e5c38e99f7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:51.305321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40554266-2157-4b85-9624-a80877c865b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:51.306223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40554266-2157-4b85-9624-a80877c865b7 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:51.306720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40554266-2157-4b85-9624-a80877c865b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:51.307358 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40554266-2157-4b85-9624-a80877c865b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-3cd86e1d-58a6-4fe7-b363-30e5c38e99f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:51.327676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:51.329085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:51.334356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 355/706] 10.222.0.77 () {56 vars in 1129 bytes} [Wed Aug 10 22:41:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:51.347202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd86e1d-58a6-4fe7-b363-30e5c38e99f7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:51.401713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40554266-2157-4b85-9624-a80877c865b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:51.404091 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40554266-2157-4b85-9624-a80877c865b7 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:51.421689 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:51.524965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 352/707] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:51.535809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40554266-2157-4b85-9624-a80877c865b7 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:51.605096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd86e1d-58a6-4fe7-b363-30e5c38e99f7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:51.647366 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf7dca-5f4a-4360-b208-f4af82f05f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:51.648375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf7dca-5f4a-4360-b208-f4af82f05f55 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:51.649024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf7dca-5f4a-4360-b208-f4af82f05f55 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:51.649425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf7dca-5f4a-4360-b208-f4af82f05f55 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:51.650147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf7dca-5f4a-4360-b208-f4af82f05f55 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:51.650898 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf7dca-5f4a-4360-b208-f4af82f05f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:51.652331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf7dca-5f4a-4360-b208-f4af82f05f55 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:51.661343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 356/708] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Aug 10 22:41:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:51.674345 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf7dca-5f4a-4360-b208-f4af82f05f55 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:51.740337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40554266-2157-4b85-9624-a80877c865b7 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:51.759544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:51.765699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:51.813312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30ea8d-223f-4c4d-8daf-d5e4c155e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:51.814213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30ea8d-223f-4c4d-8daf-d5e4c155e481 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:51.814638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30ea8d-223f-4c4d-8daf-d5e4c155e481 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:51.815051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30ea8d-223f-4c4d-8daf-d5e4c155e481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:51.836400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30ea8d-223f-4c4d-8daf-d5e4c155e481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:51.838160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30ea8d-223f-4c4d-8daf-d5e4c155e481 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-ad30ea8d-223f-4c4d-8daf-d5e4c155e481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:51.868132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:51.869355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:51.870488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:51.870488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:51.870488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:51.883581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 353/709] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:51.884849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf7dca-5f4a-4360-b208-f4af82f05f55 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:51.898329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30ea8d-223f-4c4d-8daf-d5e4c155e481 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:51.932289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6300481-97b1-40cc-844c-98c9f8d31706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:51.933249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6300481-97b1-40cc-844c-98c9f8d31706 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:51.933750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6300481-97b1-40cc-844c-98c9f8d31706 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:51.934197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6300481-97b1-40cc-844c-98c9f8d31706 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:51.935011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6300481-97b1-40cc-844c-98c9f8d31706 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:51.936128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6300481-97b1-40cc-844c-98c9f8d31706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:51.937699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6300481-97b1-40cc-844c-98c9f8d31706 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:51.951093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 357/710] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Aug 10 22:41:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:52.130418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30ea8d-223f-4c4d-8daf-d5e4c155e481 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:52.189783 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f0907-7ada-4b74-b284-b4e9a6c7d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:52.190396 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f0907-7ada-4b74-b284-b4e9a6c7d860 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:52.190668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f0907-7ada-4b74-b284-b4e9a6c7d860 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:52.190931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f0907-7ada-4b74-b284-b4e9a6c7d860 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:52.191567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f0907-7ada-4b74-b284-b4e9a6c7d860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:52.191888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f0907-7ada-4b74-b284-b4e9a6c7d860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:52.193265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f0907-7ada-4b74-b284-b4e9a6c7d860 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:52.210451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 354/711] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:52.216552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6300481-97b1-40cc-844c-98c9f8d31706 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:52.349088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6300481-97b1-40cc-844c-98c9f8d31706 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:52.357464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:52.399150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501a694-a27c-48ec-a0e0-b305746cd12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:52.399812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501a694-a27c-48ec-a0e0-b305746cd12d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:52.400088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501a694-a27c-48ec-a0e0-b305746cd12d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:52.400355 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501a694-a27c-48ec-a0e0-b305746cd12d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:52.412936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501a694-a27c-48ec-a0e0-b305746cd12d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:52.414867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501a694-a27c-48ec-a0e0-b305746cd12d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-9501a694-a27c-48ec-a0e0-b305746cd12d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:52.427896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:52.428845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:52.430135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:52.430135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:52.430135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:52.430135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:52.430135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:52.430135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:52.430135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:52.430135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:52.430135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 358/712] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:52.438465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f0907-7ada-4b74-b284-b4e9a6c7d860 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:52.486817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:52.587903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411f4b-ae97-4ed8-9a09-7f34fca7d32e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:52.588375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411f4b-ae97-4ed8-9a09-7f34fca7d32e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:52.588838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411f4b-ae97-4ed8-9a09-7f34fca7d32e None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:52.595931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 359/713] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:52.602370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f0907-7ada-4b74-b284-b4e9a6c7d860 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:52.603239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdffc9-c68b-429a-a75b-47b3efa58279 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:52.603717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdffc9-c68b-429a-a75b-47b3efa58279 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:52.604201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdffc9-c68b-429a-a75b-47b3efa58279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:52.648122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a6371-1ecc-45c7-92d4-5d976856d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:52.648744 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a6371-1ecc-45c7-92d4-5d976856d5ff None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:52.648943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e7fdffc9-c68b-429a-a75b-47b3efa58279 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:52.649049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a6371-1ecc-45c7-92d4-5d976856d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:52.649341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a6371-1ecc-45c7-92d4-5d976856d5ff None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:52.649993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a6371-1ecc-45c7-92d4-5d976856d5ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:52.650293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a6371-1ecc-45c7-92d4-5d976856d5ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:52.651028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e7fdffc9-c68b-429a-a75b-47b3efa58279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:52.651722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a6371-1ecc-45c7-92d4-5d976856d5ff None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:52.671660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 355/714] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:52.678050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a6371-1ecc-45c7-92d4-5d976856d5ff None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:52.780362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 360/715] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:52.801138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdffc9-c68b-429a-a75b-47b3efa58279 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:52.829667 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:52.864888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a6371-1ecc-45c7-92d4-5d976856d5ff None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:52.933475 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382f86d-9947-49ee-b8ac-56f8f95d9379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:52.934008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382f86d-9947-49ee-b8ac-56f8f95d9379 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:52.934284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382f86d-9947-49ee-b8ac-56f8f95d9379 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:52.934550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382f86d-9947-49ee-b8ac-56f8f95d9379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:52.935271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382f86d-9947-49ee-b8ac-56f8f95d9379 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=34568b830fc641edab39324047368546) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:52.935571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382f86d-9947-49ee-b8ac-56f8f95d9379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:52.936986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382f86d-9947-49ee-b8ac-56f8f95d9379 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:52.949321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 356/716] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:52 2022] GET /identity/v3/role_assignments?user.id=34568b830fc641edab39324047368546&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=edba0d8c079245a38a321d2d77d25419 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:52.971539 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:52.982113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdffc9-c68b-429a-a75b-47b3efa58279 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:53.033899 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce840d2-f252-4fd7-8438-61c6acad5ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:53.035031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce840d2-f252-4fd7-8438-61c6acad5ed3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:53.035530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce840d2-f252-4fd7-8438-61c6acad5ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:53.036029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce840d2-f252-4fd7-8438-61c6acad5ed3 None admin] PATH_INFO: `/v3/services/network` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:53.036815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce840d2-f252-4fd7-8438-61c6acad5ed3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:53.038516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce840d2-f252-4fd7-8438-61c6acad5ed3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-8ce840d2-f252-4fd7-8438-61c6acad5ed3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:53.054117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:53.055232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 22:41:53.056092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:53.063555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 361/717] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:52 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:53.065402 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382f86d-9947-49ee-b8ac-56f8f95d9379 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:53.212075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382f86d-9947-49ee-b8ac-56f8f95d9379 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:53.256935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2a26b-7e33-4bf1-8c5b-02627ecb6158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:53.257963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2a26b-7e33-4bf1-8c5b-02627ecb6158 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:53.258471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2a26b-7e33-4bf1-8c5b-02627ecb6158 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:53.258939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2a26b-7e33-4bf1-8c5b-02627ecb6158 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:53.259876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2a26b-7e33-4bf1-8c5b-02627ecb6158 None admin] RBAC: Adding query filter params (name=network) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:53.260378 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2a26b-7e33-4bf1-8c5b-02627ecb6158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:53.262033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2a26b-7e33-4bf1-8c5b-02627ecb6158 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:53.272263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 357/718] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:41:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:53.274038 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce840d2-f252-4fd7-8438-61c6acad5ed3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:53.376908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6023c-89c6-4dd5-87e8-fb134f3bc063 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:53.377242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6023c-89c6-4dd5-87e8-fb134f3bc063 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:53.378420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6023c-89c6-4dd5-87e8-fb134f3bc063 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:53.383502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 358/719] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:41:53.385750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026522a-6aa4-42d4-b963-a964870ae24b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:53.386168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026522a-6aa4-42d4-b963-a964870ae24b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:53.386444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026522a-6aa4-42d4-b963-a964870ae24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:53.395755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce840d2-f252-4fd7-8438-61c6acad5ed3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:53.418870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-d026522a-6aa4-42d4-b963-a964870ae24b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:53.420045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d026522a-6aa4-42d4-b963-a964870ae24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:53.437658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:53.450754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6f15-1202-4384-a12b-1bac80c1acb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:53.451385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6f15-1202-4384-a12b-1bac80c1acb2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:53.451662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6f15-1202-4384-a12b-1bac80c1acb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:53.451931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b6f15-1202-4384-a12b-1bac80c1acb2 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:53.452632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b6f15-1202-4384-a12b-1bac80c1acb2 None admin] RBAC: Adding query filter params (type=network) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:53.452876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b6f15-1202-4384-a12b-1bac80c1acb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:53.454381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b6f15-1202-4384-a12b-1bac80c1acb2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:53.459689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 362/720] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:41:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:53.539173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 359/721] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:53.582693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6f15-1202-4384-a12b-1bac80c1acb2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:53.591721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56115d8-19be-4566-b763-fab15b87104b None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:53.592054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56115d8-19be-4566-b763-fab15b87104b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:53.592285 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56115d8-19be-4566-b763-fab15b87104b None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:53.594147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 360/722] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:53.600894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80307b-de02-480c-b1d1-eb6d81eba3e3 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:53.601205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80307b-de02-480c-b1d1-eb6d81eba3e3 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:53.601602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80307b-de02-480c-b1d1-eb6d81eba3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:53.622138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ef80307b-de02-480c-b1d1-eb6d81eba3e3 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:53.623522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ef80307b-de02-480c-b1d1-eb6d81eba3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:53.635096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:53.705810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 361/723] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 22:41:53.730918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80307b-de02-480c-b1d1-eb6d81eba3e3 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:53.737696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b6f15-1202-4384-a12b-1bac80c1acb2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:53.790137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b13f-50e7-4a89-89b0-e34fe67a250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:53.791282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b13f-50e7-4a89-89b0-e34fe67a250e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:53.791932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b13f-50e7-4a89-89b0-e34fe67a250e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:53.792402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b13f-50e7-4a89-89b0-e34fe67a250e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:53.817506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340b13f-50e7-4a89-89b0-e34fe67a250e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-9340b13f-50e7-4a89-89b0-e34fe67a250e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:53.828866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:53.829909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:53.831165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 363/724] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:41:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:53.836259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b13f-50e7-4a89-89b0-e34fe67a250e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:53.842689 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:53.905172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80307b-de02-480c-b1d1-eb6d81eba3e3 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:53.952285 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd35b6-c7e7-4e0a-99ae-8e4780187ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:53.952920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd35b6-c7e7-4e0a-99ae-8e4780187ffc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:53.953191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd35b6-c7e7-4e0a-99ae-8e4780187ffc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:53.953481 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd35b6-c7e7-4e0a-99ae-8e4780187ffc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:53.970482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd35b6-c7e7-4e0a-99ae-8e4780187ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-c8dd35b6-c7e7-4e0a-99ae-8e4780187ffc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:53.976384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:53.977304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:53.978245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:53.980894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 362/725] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:41:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:53.986849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd35b6-c7e7-4e0a-99ae-8e4780187ffc None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:54.021631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:54.067828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b13f-50e7-4a89-89b0-e34fe67a250e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:54.104124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd35b6-c7e7-4e0a-99ae-8e4780187ffc None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:54.128163 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b553e80-7f0b-4e96-8546-d71e0e29cda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:54.128774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b553e80-7f0b-4e96-8546-d71e0e29cda6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:54.129046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b553e80-7f0b-4e96-8546-d71e0e29cda6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:54.129378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b553e80-7f0b-4e96-8546-d71e0e29cda6 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:54.130200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b553e80-7f0b-4e96-8546-d71e0e29cda6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:54.130499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b553e80-7f0b-4e96-8546-d71e0e29cda6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:54.132712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b553e80-7f0b-4e96-8546-d71e0e29cda6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:54.147956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 364/726] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:41:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:54.152996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b553e80-7f0b-4e96-8546-d71e0e29cda6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:54.157685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:54.162274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdcaaf-0a3f-4dbb-a27c-99d7e8b6d624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:54.163162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdcaaf-0a3f-4dbb-a27c-99d7e8b6d624 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:54.163639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdcaaf-0a3f-4dbb-a27c-99d7e8b6d624 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:54.164189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdcaaf-0a3f-4dbb-a27c-99d7e8b6d624 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:54.165199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdcaaf-0a3f-4dbb-a27c-99d7e8b6d624 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:54.165835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdcaaf-0a3f-4dbb-a27c-99d7e8b6d624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:54.167382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdcaaf-0a3f-4dbb-a27c-99d7e8b6d624 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:54.183405 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 363/727] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:54.185110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdcaaf-0a3f-4dbb-a27c-99d7e8b6d624 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:54.338619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdcaaf-0a3f-4dbb-a27c-99d7e8b6d624 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:54.365848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b553e80-7f0b-4e96-8546-d71e0e29cda6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:54.418224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834da5a4-c7ec-49b4-b2d8-046762eba916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:54.419383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834da5a4-c7ec-49b4-b2d8-046762eba916 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:54.420736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834da5a4-c7ec-49b4-b2d8-046762eba916 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:54.421432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834da5a4-c7ec-49b4-b2d8-046762eba916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:54.441019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834da5a4-c7ec-49b4-b2d8-046762eba916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:54.445664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834da5a4-c7ec-49b4-b2d8-046762eba916 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:54.451477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3ccdc-28e1-4317-85a5-8e69a0002f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:54.452478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3ccdc-28e1-4317-85a5-8e69a0002f34 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:54.452975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3ccdc-28e1-4317-85a5-8e69a0002f34 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:54.453501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3ccdc-28e1-4317-85a5-8e69a0002f34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-834da5a4-c7ec-49b4-b2d8-046762eba916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:54.464185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:54.465331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:54.466207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:54.466207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:54.466207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:54.468480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 364/728] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:54.474760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834da5a4-c7ec-49b4-b2d8-046762eba916 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:54.481703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3ccdc-28e1-4317-85a5-8e69a0002f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:54.483180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3ccdc-28e1-4317-85a5-8e69a0002f34 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:54.496417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-3ee3ccdc-28e1-4317-85a5-8e69a0002f34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:54.513583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:54.514578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:54.515463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:54.515463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:54.515463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:54.521814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 365/729] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:54.527140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3ccdc-28e1-4317-85a5-8e69a0002f34 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:54.540427 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:54.652924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834da5a4-c7ec-49b4-b2d8-046762eba916 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:54.672543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3ccdc-28e1-4317-85a5-8e69a0002f34 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:54.712947 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a9731-8b6c-4ad5-81cb-16131c72ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:54.713691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a9731-8b6c-4ad5-81cb-16131c72ef60 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:54.714044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a9731-8b6c-4ad5-81cb-16131c72ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:54.714394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a9731-8b6c-4ad5-81cb-16131c72ef60 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:54.715097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a9731-8b6c-4ad5-81cb-16131c72ef60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:54.715507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a9731-8b6c-4ad5-81cb-16131c72ef60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:54.716265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1f51b-2bdb-4096-acd2-ca91d5a23835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:54.717020 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a9731-8b6c-4ad5-81cb-16131c72ef60 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:54.717135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1f51b-2bdb-4096-acd2-ca91d5a23835 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:54.717551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1f51b-2bdb-4096-acd2-ca91d5a23835 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:54.717952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1f51b-2bdb-4096-acd2-ca91d5a23835 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:54.719001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1f51b-2bdb-4096-acd2-ca91d5a23835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:54.719452 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1f51b-2bdb-4096-acd2-ca91d5a23835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:54.721518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1f51b-2bdb-4096-acd2-ca91d5a23835 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:54.735006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 366/730] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:54.735918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 365/731] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:54.737050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e454f-f3d1-4a79-b894-fb32faf99fa4 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:54.737490 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e454f-f3d1-4a79-b894-fb32faf99fa4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:54.737823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e454f-f3d1-4a79-b894-fb32faf99fa4 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:54.738586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1f51b-2bdb-4096-acd2-ca91d5a23835 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:54.740086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 367/732] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:54.744979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e454f-f3d1-4a79-b894-fb32faf99fa4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:54.811718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:54.872874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e454f-f3d1-4a79-b894-fb32faf99fa4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:54.883204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1f51b-2bdb-4096-acd2-ca91d5a23835 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:54.893917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:54.920420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf89c5a-db50-4795-b0c8-d4999bb42b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:54.921189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf89c5a-db50-4795-b0c8-d4999bb42b76 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:54.921503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf89c5a-db50-4795-b0c8-d4999bb42b76 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:54.921866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf89c5a-db50-4795-b0c8-d4999bb42b76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:54.932833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480cdcc-e430-451b-b1de-fd9a27386a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:54.934096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480cdcc-e430-451b-b1de-fd9a27386a4f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:54.934704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480cdcc-e430-451b-b1de-fd9a27386a4f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:54.935182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf89c5a-db50-4795-b0c8-d4999bb42b76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:54.935293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480cdcc-e430-451b-b1de-fd9a27386a4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:54.936893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf89c5a-db50-4795-b0c8-d4999bb42b76 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:54.945508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480cdcc-e430-451b-b1de-fd9a27386a4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:54.947373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480cdcc-e430-451b-b1de-fd9a27386a4f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6bf89c5a-db50-4795-b0c8-d4999bb42b76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:54.960854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:54.961871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:54.962826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:54.962826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:54.962826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:54.962826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:54.962826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:54.962826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:54.962826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:54.962826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:54.962826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:41:54.962826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:54.963881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 368/733] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:41:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-6480cdcc-e430-451b-b1de-fd9a27386a4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:54.964690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:54.965678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:54.966595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:54.966595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:54.966595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:54.966595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:54.966595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:54.966595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:54.966595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:54.966595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:54.966595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:41:54.966595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:54.967119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222a888-fd9a-49fd-8771-1586e93578fc None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:54.967119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222a888-fd9a-49fd-8771-1586e93578fc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:54.967119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222a888-fd9a-49fd-8771-1586e93578fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:54.977409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 366/734] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Aug 10 22:41:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:54.979787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480cdcc-e430-451b-b1de-fd9a27386a4f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:54.997544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e222a888-fd9a-49fd-8771-1586e93578fc None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:54.998763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e222a888-fd9a-49fd-8771-1586e93578fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:55.101390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 369/735] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:55.102900 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222a888-fd9a-49fd-8771-1586e93578fc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:55.119170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480cdcc-e430-451b-b1de-fd9a27386a4f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:55.165109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeeb37-c23f-4f33-9c42-d709a14b7ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:55.165779 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeeb37-c23f-4f33-9c42-d709a14b7ef9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:55.166066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeeb37-c23f-4f33-9c42-d709a14b7ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:55.166309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeeb37-c23f-4f33-9c42-d709a14b7ef9 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:55.167044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeeb37-c23f-4f33-9c42-d709a14b7ef9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:55.167338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeeb37-c23f-4f33-9c42-d709a14b7ef9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:55.168775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeeb37-c23f-4f33-9c42-d709a14b7ef9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:55.191853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 367/736] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Aug 10 22:41:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:55.192449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:55.192684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeeb37-c23f-4f33-9c42-d709a14b7ef9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:55.225755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:55.287059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222a888-fd9a-49fd-8771-1586e93578fc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:55.312788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeeb37-c23f-4f33-9c42-d709a14b7ef9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:55.352336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb8146-9141-4ea7-b318-8e527a394bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:55.352961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb8146-9141-4ea7-b318-8e527a394bfa None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:55.353236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb8146-9141-4ea7-b318-8e527a394bfa None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:55.353535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb8146-9141-4ea7-b318-8e527a394bfa None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:55.354192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb8146-9141-4ea7-b318-8e527a394bfa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:55.354674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492cd00-17d6-47f2-b550-5e03309e188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:55.355582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb8146-9141-4ea7-b318-8e527a394bfa None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:55.356714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492cd00-17d6-47f2-b550-5e03309e188e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:55.357552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492cd00-17d6-47f2-b550-5e03309e188e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:55.358321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492cd00-17d6-47f2-b550-5e03309e188e None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:55.359953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492cd00-17d6-47f2-b550-5e03309e188e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:55.360791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492cd00-17d6-47f2-b550-5e03309e188e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:55.365685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492cd00-17d6-47f2-b550-5e03309e188e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:55.400703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 370/737] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Aug 10 22:41:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:55.402766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492cd00-17d6-47f2-b550-5e03309e188e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:55.474928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 368/738] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:41:55 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:41:55.476943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb8146-9141-4ea7-b318-8e527a394bfa None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:55.590707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492cd00-17d6-47f2-b550-5e03309e188e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:55.603609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:55.675079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:55.681458 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861ab59-67da-47e5-ada3-a3143e3a276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:55.682496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab59-67da-47e5-ada3-a3143e3a276e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:55.684000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab59-67da-47e5-ada3-a3143e3a276e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:55.684542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab59-67da-47e5-ada3-a3143e3a276e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:55.700255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb8146-9141-4ea7-b318-8e527a394bfa None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:55.760687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c03b17-17fb-4322-b92d-f689e275287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:55.761868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c03b17-17fb-4322-b92d-f689e275287c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:55.762673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c03b17-17fb-4322-b92d-f689e275287c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:55.763149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c03b17-17fb-4322-b92d-f689e275287c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:55.833418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861ab59-67da-47e5-ada3-a3143e3a276e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:55.836615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861ab59-67da-47e5-ada3-a3143e3a276e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:55.902999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c03b17-17fb-4322-b92d-f689e275287c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:55.904686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c03b17-17fb-4322-b92d-f689e275287c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:55.958917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 371/739] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:55.960317 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9445c7-efd6-41f1-b49d-5225a04e5199 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:55.960608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9445c7-efd6-41f1-b49d-5225a04e5199 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:55.960879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9445c7-efd6-41f1-b49d-5225a04e5199 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:55.962550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 372/740] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:55.964698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9445c7-efd6-41f1-b49d-5225a04e5199 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:55.977133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:56.064958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:56.097065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9445c7-efd6-41f1-b49d-5225a04e5199 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:56.105793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 369/741] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:41:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 22:41:56.108401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a0e21-4f5a-450a-a8a2-c92a063efdde None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:56.108911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a0e21-4f5a-450a-a8a2-c92a063efdde None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:56.109219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a0e21-4f5a-450a-a8a2-c92a063efdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:56.135673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-367a0e21-4f5a-450a-a8a2-c92a063efdde None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:56.138595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-367a0e21-4f5a-450a-a8a2-c92a063efdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:56.190603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34667fc-d39c-46a9-ab8d-6e295838b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:56.192221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34667fc-d39c-46a9-ab8d-6e295838b6ad None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:56.192746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34667fc-d39c-46a9-ab8d-6e295838b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:56.193223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34667fc-d39c-46a9-ab8d-6e295838b6ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:56.228580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34667fc-d39c-46a9-ab8d-6e295838b6ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:56.229793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34667fc-d39c-46a9-ab8d-6e295838b6ad None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:56.230309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 370/742] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:56.231387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a0e21-4f5a-450a-a8a2-c92a063efdde None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-d34667fc-d39c-46a9-ab8d-6e295838b6ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:56.269260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:56.271323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:56.272461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:56.272461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:56.272461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:56.278571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 373/743] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:56.280291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff55c-c3d2-4fed-ae9b-e6ba77de3d5f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:56.280687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff55c-c3d2-4fed-ae9b-e6ba77de3d5f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:56.281081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ff55c-c3d2-4fed-ae9b-e6ba77de3d5f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:56.287382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 374/744] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:56.288574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ff55c-c3d2-4fed-ae9b-e6ba77de3d5f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:56.354627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:56.373948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a0e21-4f5a-450a-a8a2-c92a063efdde None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:56.401914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:56.425630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ff55c-c3d2-4fed-ae9b-e6ba77de3d5f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:56.439146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa145-56fc-4110-9549-5518a65f38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:56.439741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa145-56fc-4110-9549-5518a65f38a3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:56.439915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa145-56fc-4110-9549-5518a65f38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:56.440090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa145-56fc-4110-9549-5518a65f38a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:56.453528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46faa145-56fc-4110-9549-5518a65f38a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:56.455707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46faa145-56fc-4110-9549-5518a65f38a3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:56.472235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4179964-a25b-45be-a0d9-c672dc47e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-46faa145-56fc-4110-9549-5518a65f38a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:56.472517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:56.474686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:56.476761 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:56.476761 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:56.476761 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:56.477072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4179964-a25b-45be-a0d9-c672dc47e9ce None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:56.477072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4179964-a25b-45be-a0d9-c672dc47e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:56.477072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4179964-a25b-45be-a0d9-c672dc47e9ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:56.477254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 371/745] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:56.477254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa145-56fc-4110-9549-5518a65f38a3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:56.499081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4179964-a25b-45be-a0d9-c672dc47e9ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a4179964-a25b-45be-a0d9-c672dc47e9ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:41:56.505716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:56.507304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:41:56.509704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:56.512196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 375/746] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:41:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:56.513768 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d922c-6dd3-432e-ba42-622f2194c6fa None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:56.514104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d922c-6dd3-432e-ba42-622f2194c6fa None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:56.514375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d922c-6dd3-432e-ba42-622f2194c6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:56.535535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-086d922c-6dd3-432e-ba42-622f2194c6fa None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:56.536863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-086d922c-6dd3-432e-ba42-622f2194c6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:56.666566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa145-56fc-4110-9549-5518a65f38a3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:56.672259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 376/747] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 22:41:56.673386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d922c-6dd3-432e-ba42-622f2194c6fa None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:56.742274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e26da1-817a-420c-99dd-78bd0dcba4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:56.742944 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e26da1-817a-420c-99dd-78bd0dcba4fc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:56.743221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e26da1-817a-420c-99dd-78bd0dcba4fc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:56.743493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e26da1-817a-420c-99dd-78bd0dcba4fc None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:56.743641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:56.744221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e26da1-817a-420c-99dd-78bd0dcba4fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:56.744528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e26da1-817a-420c-99dd-78bd0dcba4fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:56.745947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e26da1-817a-420c-99dd-78bd0dcba4fc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:56.760709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 372/748] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:56.761927 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e26da1-817a-420c-99dd-78bd0dcba4fc None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:56.795899 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:56.815253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d922c-6dd3-432e-ba42-622f2194c6fa None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:56.863335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5f1a1-9e92-457f-a113-89fb97b7fd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:56.864657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5f1a1-9e92-457f-a113-89fb97b7fd4f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:56.864937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5f1a1-9e92-457f-a113-89fb97b7fd4f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:56.865216 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5f1a1-9e92-457f-a113-89fb97b7fd4f None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:56.866014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5f1a1-9e92-457f-a113-89fb97b7fd4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:56.866321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5f1a1-9e92-457f-a113-89fb97b7fd4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:56.867874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5f1a1-9e92-457f-a113-89fb97b7fd4f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:56.887742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 377/749] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:56.887742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5f1a1-9e92-457f-a113-89fb97b7fd4f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:56.892103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e26da1-817a-420c-99dd-78bd0dcba4fc None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:56.941234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd5920-6d05-4ca1-a4a2-fb47ce2714c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:56.942221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd5920-6d05-4ca1-a4a2-fb47ce2714c4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:56.942694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd5920-6d05-4ca1-a4a2-fb47ce2714c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:56.943085 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd5920-6d05-4ca1-a4a2-fb47ce2714c4 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:56.943997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd5920-6d05-4ca1-a4a2-fb47ce2714c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:56.944524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd5920-6d05-4ca1-a4a2-fb47ce2714c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:56.947226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd5920-6d05-4ca1-a4a2-fb47ce2714c4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:56.960961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 373/750] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:41:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:56.961999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd5920-6d05-4ca1-a4a2-fb47ce2714c4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:57.050807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5f1a1-9e92-457f-a113-89fb97b7fd4f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:57.055619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:57.099826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480d9a-ca91-4382-8175-a55ab87a668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:57.100446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480d9a-ca91-4382-8175-a55ab87a668d None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:57.100721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480d9a-ca91-4382-8175-a55ab87a668d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:57.100988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480d9a-ca91-4382-8175-a55ab87a668d None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:57.101705 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc480d9a-ca91-4382-8175-a55ab87a668d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:57.105158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc480d9a-ca91-4382-8175-a55ab87a668d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:57.118714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:57.140959 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd5920-6d05-4ca1-a4a2-fb47ce2714c4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:57.197706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 378/751] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:41:56 2022] POST /identity/v3/services => generated 240 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:41:57.198925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480d9a-ca91-4382-8175-a55ab87a668d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:57.228891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631260-4f5f-4cb8-82b2-d5ad8f3e3b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:57.229956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631260-4f5f-4cb8-82b2-d5ad8f3e3b4b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:57.230267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631260-4f5f-4cb8-82b2-d5ad8f3e3b4b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:57.230641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631260-4f5f-4cb8-82b2-d5ad8f3e3b4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:57.248039 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d631260-4f5f-4cb8-82b2-d5ad8f3e3b4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:57.251440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d631260-4f5f-4cb8-82b2-d5ad8f3e3b4b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5d631260-4f5f-4cb8-82b2-d5ad8f3e3b4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:57.274951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:57.276764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:57.278586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:57.278586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:57.278586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:57.278586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:57.278586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:57.278586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:57.278586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:57.278586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:57.282272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 374/752] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:57.283773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631260-4f5f-4cb8-82b2-d5ad8f3e3b4b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:57.380608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480d9a-ca91-4382-8175-a55ab87a668d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:57.429435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98baea-1a34-4418-a35d-b71fb69e5df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:57.430492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98baea-1a34-4418-a35d-b71fb69e5df9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:57.430872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98baea-1a34-4418-a35d-b71fb69e5df9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:57.431143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98baea-1a34-4418-a35d-b71fb69e5df9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:57.444581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98baea-1a34-4418-a35d-b71fb69e5df9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:57.446625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98baea-1a34-4418-a35d-b71fb69e5df9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:57.450050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631260-4f5f-4cb8-82b2-d5ad8f3e3b4b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-1f98baea-1a34-4418-a35d-b71fb69e5df9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:57.468515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:57.469580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:57.470459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:57.470459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:57.470459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:57.470459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:57.470459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:57.470459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:57.470459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:57.470459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:57.471386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 379/753] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:57.472506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98baea-1a34-4418-a35d-b71fb69e5df9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:57.500987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e48f92-038f-4ec8-bc5b-1697f80bab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:57.501649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e48f92-038f-4ec8-bc5b-1697f80bab3d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:57.501922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e48f92-038f-4ec8-bc5b-1697f80bab3d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:57.502182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e48f92-038f-4ec8-bc5b-1697f80bab3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:57.516224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e48f92-038f-4ec8-bc5b-1697f80bab3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:57.517811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e48f92-038f-4ec8-bc5b-1697f80bab3d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:57.520319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:57.523766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-06e48f92-038f-4ec8-bc5b-1697f80bab3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:57.557321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:57.558489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:57.559366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:57.559366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:57.559366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:57.559366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 375/754] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:57.559366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e48f92-038f-4ec8-bc5b-1697f80bab3d None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:57.635631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98baea-1a34-4418-a35d-b71fb69e5df9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:57.688013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13fb05-c450-43ba-94b0-6f17e41ae1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:57.688655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13fb05-c450-43ba-94b0-6f17e41ae1e3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:57.689172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13fb05-c450-43ba-94b0-6f17e41ae1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:57.689939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13fb05-c450-43ba-94b0-6f17e41ae1e3 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:57.690822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13fb05-c450-43ba-94b0-6f17e41ae1e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:57.692392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13fb05-c450-43ba-94b0-6f17e41ae1e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:57.694300 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13fb05-c450-43ba-94b0-6f17e41ae1e3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:57.711682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 380/755] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:57.714733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13fb05-c450-43ba-94b0-6f17e41ae1e3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:57.734030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e48f92-038f-4ec8-bc5b-1697f80bab3d None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:57.793575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84762072-d8b4-48fe-bdd0-7e9e89b654c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:57.794641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84762072-d8b4-48fe-bdd0-7e9e89b654c4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:57.795180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84762072-d8b4-48fe-bdd0-7e9e89b654c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:57.795647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84762072-d8b4-48fe-bdd0-7e9e89b654c4 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:57.796970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84762072-d8b4-48fe-bdd0-7e9e89b654c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:57.797542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84762072-d8b4-48fe-bdd0-7e9e89b654c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:57.800204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84762072-d8b4-48fe-bdd0-7e9e89b654c4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:57.829730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 376/756] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:57.831327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84762072-d8b4-48fe-bdd0-7e9e89b654c4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:57.840098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:57.848938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13fb05-c450-43ba-94b0-6f17e41ae1e3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:57.901824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a73751-2a4b-4806-bf13-0bb48aab12a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:57.902870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a73751-2a4b-4806-bf13-0bb48aab12a2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:57.903233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a73751-2a4b-4806-bf13-0bb48aab12a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:57.903666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a73751-2a4b-4806-bf13-0bb48aab12a2 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:57.904735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a73751-2a4b-4806-bf13-0bb48aab12a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:57.905596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a73751-2a4b-4806-bf13-0bb48aab12a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:57.907119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a73751-2a4b-4806-bf13-0bb48aab12a2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:57.913214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:57.926888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 381/757] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:57.928258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a73751-2a4b-4806-bf13-0bb48aab12a2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:57.976811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84762072-d8b4-48fe-bdd0-7e9e89b654c4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:58.018423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276469a-cb65-498c-9425-5ea3d16bf197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:58.019031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276469a-cb65-498c-9425-5ea3d16bf197 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:58.019305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276469a-cb65-498c-9425-5ea3d16bf197 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:58.019576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276469a-cb65-498c-9425-5ea3d16bf197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:58.020348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276469a-cb65-498c-9425-5ea3d16bf197 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=6c892a519c8348728d43f0f0d447a321) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:58.020653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276469a-cb65-498c-9425-5ea3d16bf197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:58.022219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276469a-cb65-498c-9425-5ea3d16bf197 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:58.028871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 377/758] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:57 2022] GET /identity/v3/role_assignments?user.id=6c892a519c8348728d43f0f0d447a321&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=edba0d8c079245a38a321d2d77d25419 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:58.029794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276469a-cb65-498c-9425-5ea3d16bf197 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:58.078077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a73751-2a4b-4806-bf13-0bb48aab12a2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:58.131173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c038c-8231-43a5-9b06-f516abaa26d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:58.132214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c038c-8231-43a5-9b06-f516abaa26d9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:58.132721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c038c-8231-43a5-9b06-f516abaa26d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:58.133205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c038c-8231-43a5-9b06-f516abaa26d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:58.134289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c038c-8231-43a5-9b06-f516abaa26d9 None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=3500bd875ccf4a3c8302d0f6ce11c12b) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:58.134815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c038c-8231-43a5-9b06-f516abaa26d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:58.136616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c038c-8231-43a5-9b06-f516abaa26d9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:58.149815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 382/759] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:41:57 2022] GET /identity/v3/role_assignments?user.id=3500bd875ccf4a3c8302d0f6ce11c12b&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:58.151663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a012-a279-4d30-8408-426a15edec6e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:58.152213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a012-a279-4d30-8408-426a15edec6e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:58.152696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a012-a279-4d30-8408-426a15edec6e None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:58.154781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 383/760] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:58.160307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03826c6-1475-468f-ba05-927a63e4f67f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:58.160988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03826c6-1475-468f-ba05-927a63e4f67f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:58.161599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03826c6-1475-468f-ba05-927a63e4f67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:58.197058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e03826c6-1475-468f-ba05-927a63e4f67f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:58.198502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e03826c6-1475-468f-ba05-927a63e4f67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:41:58.201510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:58.208247 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276469a-cb65-498c-9425-5ea3d16bf197 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:58.246350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:58.276806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0259be2-2e78-4db7-8dcc-db53b3dfb0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:58.277892 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259be2-2e78-4db7-8dcc-db53b3dfb0cf None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:58.278345 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259be2-2e78-4db7-8dcc-db53b3dfb0cf None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:58.278798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259be2-2e78-4db7-8dcc-db53b3dfb0cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:58.314592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 384/761] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:41:58.314793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0259be2-2e78-4db7-8dcc-db53b3dfb0cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:58.316298 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0259be2-2e78-4db7-8dcc-db53b3dfb0cf None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:58.344984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03826c6-1475-468f-ba05-927a63e4f67f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-c0259be2-2e78-4db7-8dcc-db53b3dfb0cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:41:58.347743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:58.348998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:58.349985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:58.349985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:58.349985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:41:58.349985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:41:58.349985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:41:58.349985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:41:58.349985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:41:58.349985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:41:58.349985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:41:58.349985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:58.352047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 378/762] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Aug 10 22:41:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:58.356933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0259be2-2e78-4db7-8dcc-db53b3dfb0cf None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:58.517038 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03826c6-1475-468f-ba05-927a63e4f67f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:58.580469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0259be2-2e78-4db7-8dcc-db53b3dfb0cf None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:58.588755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24d615-35db-4fe8-ad67-b934907fd675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:58.589418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d615-35db-4fe8-ad67-b934907fd675 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:58.589696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d615-35db-4fe8-ad67-b934907fd675 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:58.591739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d615-35db-4fe8-ad67-b934907fd675 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:58.592336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24d615-35db-4fe8-ad67-b934907fd675 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:58.593739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24d615-35db-4fe8-ad67-b934907fd675 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-8f24d615-35db-4fe8-ad67-b934907fd675 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:58.604322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:58.605414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:58.606658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 385/763] 10.222.0.77 () {56 vars in 1129 bytes} [Wed Aug 10 22:41:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:58.618846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24d615-35db-4fe8-ad67-b934907fd675 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:58.621759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:58.687551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96e835-f26e-47ac-ae8f-95cc2349bc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:58.688176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96e835-f26e-47ac-ae8f-95cc2349bc8d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:58.688457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96e835-f26e-47ac-ae8f-95cc2349bc8d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:58.688715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96e835-f26e-47ac-ae8f-95cc2349bc8d None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:58.689479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96e835-f26e-47ac-ae8f-95cc2349bc8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:58.689781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96e835-f26e-47ac-ae8f-95cc2349bc8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:58.691302 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96e835-f26e-47ac-ae8f-95cc2349bc8d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:58.729482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 379/764] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Aug 10 22:41:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:58.735279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96e835-f26e-47ac-ae8f-95cc2349bc8d None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:58.743328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24d615-35db-4fe8-ad67-b934907fd675 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:58.784143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829beaf2-c571-4bc2-93c0-5f2eeaaa3f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:58.785112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829beaf2-c571-4bc2-93c0-5f2eeaaa3f42 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:58.786364 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829beaf2-c571-4bc2-93c0-5f2eeaaa3f42 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:58.786842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829beaf2-c571-4bc2-93c0-5f2eeaaa3f42 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:58.787696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829beaf2-c571-4bc2-93c0-5f2eeaaa3f42 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:58.788199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829beaf2-c571-4bc2-93c0-5f2eeaaa3f42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:58.789906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829beaf2-c571-4bc2-93c0-5f2eeaaa3f42 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:58.795590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 386/765] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Aug 10 22:41:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:58.801385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829beaf2-c571-4bc2-93c0-5f2eeaaa3f42 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:58.826851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:58.881765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:58.920341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829beaf2-c571-4bc2-93c0-5f2eeaaa3f42 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:58.961758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b08c30-aa0b-49f1-bd66-1ec2e7dbef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:58.962769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b08c30-aa0b-49f1-bd66-1ec2e7dbef7c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:58.963283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b08c30-aa0b-49f1-bd66-1ec2e7dbef7c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:58.963749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b08c30-aa0b-49f1-bd66-1ec2e7dbef7c None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:58.964638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b08c30-aa0b-49f1-bd66-1ec2e7dbef7c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:58.965190 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b08c30-aa0b-49f1-bd66-1ec2e7dbef7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:58.966883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b08c30-aa0b-49f1-bd66-1ec2e7dbef7c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:58.973788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 387/766] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Aug 10 22:41:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:58.979834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b08c30-aa0b-49f1-bd66-1ec2e7dbef7c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:58.996292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96e835-f26e-47ac-ae8f-95cc2349bc8d None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:59.098978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8eded-0382-4d90-9c4a-10c7827c63cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:59.099586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8eded-0382-4d90-9c4a-10c7827c63cf None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:59.099864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8eded-0382-4d90-9c4a-10c7827c63cf None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:59.100133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8eded-0382-4d90-9c4a-10c7827c63cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:59.110432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b08c30-aa0b-49f1-bd66-1ec2e7dbef7c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:59.123627 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8eded-0382-4d90-9c4a-10c7827c63cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:59.125134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8eded-0382-4d90-9c4a-10c7827c63cf None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:59.151520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:59.155174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97bafa-3a4a-4554-a951-d4587b8eb0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-94e8eded-0382-4d90-9c4a-10c7827c63cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:41:59.155894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:59.156926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:41:59.157846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:41:59.157846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:41:59.157846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:41:59.158659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97bafa-3a4a-4554-a951-d4587b8eb0ac None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:59.159165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97bafa-3a4a-4554-a951-d4587b8eb0ac None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:59.159626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97bafa-3a4a-4554-a951-d4587b8eb0ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:59.160760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97bafa-3a4a-4554-a951-d4587b8eb0ac None admin] RBAC: Adding query filter params (interface=public, service_id=5c5a50cfe15c4b2490949cf1baab9bbd, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:59.161308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97bafa-3a4a-4554-a951-d4587b8eb0ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:59.162966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97bafa-3a4a-4554-a951-d4587b8eb0ac None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:59.165744 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 380/767] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:41:59.166705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8eded-0382-4d90-9c4a-10c7827c63cf None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:59.172615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 388/768] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Aug 10 22:41:58 2022] GET /identity/v3/endpoints?service_id=5c5a50cfe15c4b2490949cf1baab9bbd&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:59.178351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97bafa-3a4a-4554-a951-d4587b8eb0ac None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:59.295267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97bafa-3a4a-4554-a951-d4587b8eb0ac None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:59.337501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630c29f-932b-4bb7-a04b-cc026c5cd888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:59.338487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630c29f-932b-4bb7-a04b-cc026c5cd888 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:59.339453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630c29f-932b-4bb7-a04b-cc026c5cd888 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:59.339937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630c29f-932b-4bb7-a04b-cc026c5cd888 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:59.340750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630c29f-932b-4bb7-a04b-cc026c5cd888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:59.342712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630c29f-932b-4bb7-a04b-cc026c5cd888 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:59.349320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 389/769] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Aug 10 22:41:59 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:41:59.417116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:59.433929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8eded-0382-4d90-9c4a-10c7827c63cf None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:59.486353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff74c65-5f97-4d8a-8b36-6229aae1e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:59.486925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff74c65-5f97-4d8a-8b36-6229aae1e556 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:59.487201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff74c65-5f97-4d8a-8b36-6229aae1e556 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:59.487474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff74c65-5f97-4d8a-8b36-6229aae1e556 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:59.488119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff74c65-5f97-4d8a-8b36-6229aae1e556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:41:59.488419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff74c65-5f97-4d8a-8b36-6229aae1e556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:59.490372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff74c65-5f97-4d8a-8b36-6229aae1e556 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:59.510337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 381/770] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:41:59.516325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630c29f-932b-4bb7-a04b-cc026c5cd888 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:59.621895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:41:59.677943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630c29f-932b-4bb7-a04b-cc026c5cd888 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:41:59.745732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4be419-fab7-4f24-8ac9-de51f4ecf7dc None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:59.746372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4be419-fab7-4f24-8ac9-de51f4ecf7dc None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:59.746847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4be419-fab7-4f24-8ac9-de51f4ecf7dc None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:59.748401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127fe8f-132c-4888-9619-8b53b85c323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:41:59.749123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127fe8f-132c-4888-9619-8b53b85c323b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:59.749351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127fe8f-132c-4888-9619-8b53b85c323b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:59.749735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127fe8f-132c-4888-9619-8b53b85c323b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:59.749943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 382/771] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:41:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:41:59.758051 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127fe8f-132c-4888-9619-8b53b85c323b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:41:59.759569 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127fe8f-132c-4888-9619-8b53b85c323b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:41:59.765697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a80e-554b-429c-a66d-b7fd304d8a16 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:41:59.766166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a80e-554b-429c-a66d-b7fd304d8a16 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:41:59.766579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a80e-554b-429c-a66d-b7fd304d8a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-d127fe8f-132c-4888-9619-8b53b85c323b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:41:59.776683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:41:59.777684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:41:59.778563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:41:59.778563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:41:59.778563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:41:59.778563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:41:59.778563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:41:59.778563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:41:59.778563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:41:59.778563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:41:59.778563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 390/772] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:41:59.785680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127fe8f-132c-4888-9619-8b53b85c323b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:41:59.822758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-1435a80e-554b-429c-a66d-b7fd304d8a16 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:41:59.824737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1435a80e-554b-429c-a66d-b7fd304d8a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:00.003129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127fe8f-132c-4888-9619-8b53b85c323b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:00.024361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:00.045111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f1d47-d320-4889-90ec-9b02fb6d6f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:00.045778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f1d47-d320-4889-90ec-9b02fb6d6f37 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:00.046311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f1d47-d320-4889-90ec-9b02fb6d6f37 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:00.046595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f1d47-d320-4889-90ec-9b02fb6d6f37 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:00.047515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f1d47-d320-4889-90ec-9b02fb6d6f37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:00.047814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f1d47-d320-4889-90ec-9b02fb6d6f37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:00.049343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f1d47-d320-4889-90ec-9b02fb6d6f37 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:00.067081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 391/773] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:00.072764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f1d47-d320-4889-90ec-9b02fb6d6f37 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:00.088048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 383/774] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:41:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:00.125024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a80e-554b-429c-a66d-b7fd304d8a16 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:00.224199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f1d47-d320-4889-90ec-9b02fb6d6f37 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:00.286380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe19bff-c35f-4097-b447-7eb209aa0987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:00.287640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe19bff-c35f-4097-b447-7eb209aa0987 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:00.287922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe19bff-c35f-4097-b447-7eb209aa0987 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:00.288196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe19bff-c35f-4097-b447-7eb209aa0987 None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/34568b830fc641edab39324047368546/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:00.290480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe19bff-c35f-4097-b447-7eb209aa0987 None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=34568b830fc641edab39324047368546, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:00.291996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe19bff-c35f-4097-b447-7eb209aa0987 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:00.352198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:00.366410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 392/775] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:42:00 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/34568b830fc641edab39324047368546/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:42:00.383904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a80e-554b-429c-a66d-b7fd304d8a16 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:00.431643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51003b-1ff3-47b1-9fb9-e3b3b15890d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:00.432306 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51003b-1ff3-47b1-9fb9-e3b3b15890d1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:00.432585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51003b-1ff3-47b1-9fb9-e3b3b15890d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:00.432857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51003b-1ff3-47b1-9fb9-e3b3b15890d1 None admin] PATH_INFO: `/v3/services/network` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:00.433479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51003b-1ff3-47b1-9fb9-e3b3b15890d1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:00.434882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51003b-1ff3-47b1-9fb9-e3b3b15890d1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-ef51003b-1ff3-47b1-9fb9-e3b3b15890d1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:00.451267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:00.452309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 22:42:00.453117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:00.455240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 384/776] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:00 2022] GET /identity/v3/services/network => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:00.463718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe19bff-c35f-4097-b447-7eb209aa0987 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:00.593730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:00.688320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe19bff-c35f-4097-b447-7eb209aa0987 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:00.732174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be5832-7c2c-434c-a218-052cd0dc598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:00.733182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be5832-7c2c-434c-a218-052cd0dc598f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:00.733629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be5832-7c2c-434c-a218-052cd0dc598f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:00.734064 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be5832-7c2c-434c-a218-052cd0dc598f None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:00.734880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be5832-7c2c-434c-a218-052cd0dc598f None admin] RBAC: Adding query filter params (name=network) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:00.735341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be5832-7c2c-434c-a218-052cd0dc598f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:00.736878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be5832-7c2c-434c-a218-052cd0dc598f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:00.743235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 393/777] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:00.748670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51003b-1ff3-47b1-9fb9-e3b3b15890d1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:00.870708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead0fb-33e4-41c5-b722-9c767a9c7c25 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:00.871630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead0fb-33e4-41c5-b722-9c767a9c7c25 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:00.872095 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fead0fb-33e4-41c5-b722-9c767a9c7c25 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:00.874868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 394/778] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:00.879286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bae79-a484-4209-b4a4-8b8a1dad2286 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:00.879581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bae79-a484-4209-b4a4-8b8a1dad2286 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:00.879845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bae79-a484-4209-b4a4-8b8a1dad2286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:00.903346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51003b-1ff3-47b1-9fb9-e3b3b15890d1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:00.913399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-474bae79-a484-4209-b4a4-8b8a1dad2286 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:00.915660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-474bae79-a484-4209-b4a4-8b8a1dad2286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:00.947691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02050973-91ad-4416-ae35-9a6011bcc622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:00.948314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02050973-91ad-4416-ae35-9a6011bcc622 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:00.948590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02050973-91ad-4416-ae35-9a6011bcc622 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:00.948860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02050973-91ad-4416-ae35-9a6011bcc622 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:00.949530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02050973-91ad-4416-ae35-9a6011bcc622 None admin] RBAC: Adding query filter params (type=network) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:00.949832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02050973-91ad-4416-ae35-9a6011bcc622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:00.951233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02050973-91ad-4416-ae35-9a6011bcc622 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:00.958504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 385/779] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:00.959871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999675-b326-4d66-88be-01e346daab3e None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:00.960161 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999675-b326-4d66-88be-01e346daab3e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:00.960426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999675-b326-4d66-88be-01e346daab3e None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:00.961815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 386/780] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:00.967703 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb999675-b326-4d66-88be-01e346daab3e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:00.982657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:01.041316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 395/781] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:01.041316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e450-0789-402d-9f5b-449e147eb106 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:01.041316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e450-0789-402d-9f5b-449e147eb106 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:01.041316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e450-0789-402d-9f5b-449e147eb106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:01.064915 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b749e450-0789-402d-9f5b-449e147eb106 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:01.066700 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b749e450-0789-402d-9f5b-449e147eb106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:01.110359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:01.130956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb999675-b326-4d66-88be-01e346daab3e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:01.177319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 396/782] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:01.177319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749e450-0789-402d-9f5b-449e147eb106 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:01.195330 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f977358-0f3b-4822-942d-023ecbf08112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:01.196106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f977358-0f3b-4822-942d-023ecbf08112 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:01.196472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f977358-0f3b-4822-942d-023ecbf08112 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:01.196745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f977358-0f3b-4822-942d-023ecbf08112 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:01.197729 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f977358-0f3b-4822-942d-023ecbf08112 None admin] RBAC: Adding query filter params (interface=public, service_id=fa38b5028ff64263af1a579dd4c8e8ca, region_id=RegionOne) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:01.198042 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f977358-0f3b-4822-942d-023ecbf08112 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:01.199913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f977358-0f3b-4822-942d-023ecbf08112 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:01.209878 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 387/783] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Aug 10 22:42:00 2022] GET /identity/v3/endpoints?service_id=fa38b5028ff64263af1a579dd4c8e8ca&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:01.210825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f977358-0f3b-4822-942d-023ecbf08112 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:01.297060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:01.307155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749e450-0789-402d-9f5b-449e147eb106 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:01.329827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f977358-0f3b-4822-942d-023ecbf08112 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:01.349105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1fcd2-8c50-47d2-b62e-fe018609a130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:01.350548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1fcd2-8c50-47d2-b62e-fe018609a130 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:01.351357 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1fcd2-8c50-47d2-b62e-fe018609a130 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:01.352077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1fcd2-8c50-47d2-b62e-fe018609a130 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:01.372125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddb248-2499-4e65-a060-ef37e2185fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:01.372686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb248-2499-4e65-a060-ef37e2185fae None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:01.372957 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb248-2499-4e65-a060-ef37e2185fae None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:01.373229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb248-2499-4e65-a060-ef37e2185fae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:01.374563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1fcd2-8c50-47d2-b62e-fe018609a130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-8fa1fcd2-8c50-47d2-b62e-fe018609a130 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:01.384865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:01.386616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:42:01.388089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:01.388808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddb248-2499-4e65-a060-ef37e2185fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:01.397438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 397/784] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:42:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:01.397438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1fcd2-8c50-47d2-b62e-fe018609a130 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-99ddb248-2499-4e65-a060-ef37e2185fae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:01.397698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:01.398841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:01.399686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 388/785] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:01.401443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddb248-2499-4e65-a060-ef37e2185fae None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:01.460660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:01.561480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddb248-2499-4e65-a060-ef37e2185fae None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:01.571631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1fcd2-8c50-47d2-b62e-fe018609a130 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:01.607721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:01.623861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce7ee5-9bbb-407f-921d-da40ac40d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:01.625151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce7ee5-9bbb-407f-921d-da40ac40d613 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:01.625899 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce7ee5-9bbb-407f-921d-da40ac40d613 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:01.626532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce7ee5-9bbb-407f-921d-da40ac40d613 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:01.627867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce7ee5-9bbb-407f-921d-da40ac40d613 None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:01.628812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce7ee5-9bbb-407f-921d-da40ac40d613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:01.631795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039da8a-2a96-4a21-ad09-83022148b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:01.632189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce7ee5-9bbb-407f-921d-da40ac40d613 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:01.632656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039da8a-2a96-4a21-ad09-83022148b69f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:01.633037 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039da8a-2a96-4a21-ad09-83022148b69f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:01.633442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039da8a-2a96-4a21-ad09-83022148b69f None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:01.634169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039da8a-2a96-4a21-ad09-83022148b69f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:01.635755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039da8a-2a96-4a21-ad09-83022148b69f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:01.642263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 398/786] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Aug 10 22:42:01 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:01.643675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039da8a-2a96-4a21-ad09-83022148b69f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:01.653408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 389/787] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:01.661118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce7ee5-9bbb-407f-921d-da40ac40d613 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:01.776391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:01.826993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039da8a-2a96-4a21-ad09-83022148b69f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:01.831946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce7ee5-9bbb-407f-921d-da40ac40d613 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:01.885669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bca53-0912-40a1-880b-497ea5fa8b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:01.886961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bca53-0912-40a1-880b-497ea5fa8b69 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:01.889156 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bca53-0912-40a1-880b-497ea5fa8b69 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:01.889722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bca53-0912-40a1-880b-497ea5fa8b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:01.919859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bca53-0912-40a1-880b-497ea5fa8b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:01.922391 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bca53-0912-40a1-880b-497ea5fa8b69 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:01.926415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971700-844a-4504-9249-83a6389cc036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:01.927815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971700-844a-4504-9249-83a6389cc036 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:01.928315 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971700-844a-4504-9249-83a6389cc036 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:01.928925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5971700-844a-4504-9249-83a6389cc036 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:01.929907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971700-844a-4504-9249-83a6389cc036 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:01.931809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971700-844a-4504-9249-83a6389cc036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:01.933508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5971700-844a-4504-9249-83a6389cc036 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:01.950479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 399/788] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d41bca53-0912-40a1-880b-497ea5fa8b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:01.953534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:01.954466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:01.955437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:01.955437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:01.955437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:01.957729 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 390/789] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:01.964258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bca53-0912-40a1-880b-497ea5fa8b69 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:01.964900 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971700-844a-4504-9249-83a6389cc036 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:02.029791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:02.100479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5971700-844a-4504-9249-83a6389cc036 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:02.142052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963bd94-ffd6-4bb2-b482-91c34552420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:02.142244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bca53-0912-40a1-880b-497ea5fa8b69 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:02.143514 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963bd94-ffd6-4bb2-b482-91c34552420a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:02.143975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963bd94-ffd6-4bb2-b482-91c34552420a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:02.144437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963bd94-ffd6-4bb2-b482-91c34552420a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:02.158089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963bd94-ffd6-4bb2-b482-91c34552420a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:02.159874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963bd94-ffd6-4bb2-b482-91c34552420a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:02.170189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a963bd94-ffd6-4bb2-b482-91c34552420a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:02.178268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:02.187108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:02.188101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:02.188101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:02.188101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:02.188101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 400/790] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:02.188985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963bd94-ffd6-4bb2-b482-91c34552420a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:02.242433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3886b-bbef-430b-a2f6-6b308e48deef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:02.243691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3886b-bbef-430b-a2f6-6b308e48deef None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:02.244022 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3886b-bbef-430b-a2f6-6b308e48deef None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:02.244491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3886b-bbef-430b-a2f6-6b308e48deef None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:02.245455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3886b-bbef-430b-a2f6-6b308e48deef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:02.245737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3886b-bbef-430b-a2f6-6b308e48deef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:02.247816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3886b-bbef-430b-a2f6-6b308e48deef None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:02.276712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 391/791] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:02.284002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3886b-bbef-430b-a2f6-6b308e48deef None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:02.370218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963bd94-ffd6-4bb2-b482-91c34552420a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:02.414823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0f4c2-f131-49fd-949c-8edeeee270b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:02.415364 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0f4c2-f131-49fd-949c-8edeeee270b8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:02.415639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0f4c2-f131-49fd-949c-8edeeee270b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:02.415908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0f4c2-f131-49fd-949c-8edeeee270b8 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:02.416652 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0f4c2-f131-49fd-949c-8edeeee270b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:02.416959 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0f4c2-f131-49fd-949c-8edeeee270b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:02.418506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0f4c2-f131-49fd-949c-8edeeee270b8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:02.432004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 401/792] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:02.433453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb67f6a-3e5c-4ea3-b114-668e58e4b0ae None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:02.433726 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb67f6a-3e5c-4ea3-b114-668e58e4b0ae None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:02.433991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb67f6a-3e5c-4ea3-b114-668e58e4b0ae None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:02.439823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 402/793] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:02.441368 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7433a-b507-4612-b10e-94dfeabfe7e7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:02.442195 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7433a-b507-4612-b10e-94dfeabfe7e7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:02.442466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7433a-b507-4612-b10e-94dfeabfe7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:02.461732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3886b-bbef-430b-a2f6-6b308e48deef None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:02.463738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-87c7433a-b507-4612-b10e-94dfeabfe7e7 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:02.465699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-87c7433a-b507-4612-b10e-94dfeabfe7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:02.471425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:02.508707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b9b7f-ffac-4925-ad0b-8985024b783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:02.509536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b9b7f-ffac-4925-ad0b-8985024b783a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:02.509880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b9b7f-ffac-4925-ad0b-8985024b783a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:02.510200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b9b7f-ffac-4925-ad0b-8985024b783a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:02.518824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b9b7f-ffac-4925-ad0b-8985024b783a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:02.521601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b9b7f-ffac-4925-ad0b-8985024b783a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5d9b9b7f-ffac-4925-ad0b-8985024b783a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:02.536170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:02.538189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 392/794] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Aug 10 22:42:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:02.539908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b9b7f-ffac-4925-ad0b-8985024b783a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:02.561740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:02.581474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 403/795] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:02.582921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7433a-b507-4612-b10e-94dfeabfe7e7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:02.670250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b9b7f-ffac-4925-ad0b-8985024b783a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:02.715482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef53503-9777-4144-8d93-e68d91b01199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:02.716176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef53503-9777-4144-8d93-e68d91b01199 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:02.716534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef53503-9777-4144-8d93-e68d91b01199 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:02.716850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef53503-9777-4144-8d93-e68d91b01199 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:02.725750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7433a-b507-4612-b10e-94dfeabfe7e7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:02.726458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef53503-9777-4144-8d93-e68d91b01199 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:02.728010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef53503-9777-4144-8d93-e68d91b01199 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-9ef53503-9777-4144-8d93-e68d91b01199 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:02.741466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:02.743232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 393/796] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:42:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:02.745024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef53503-9777-4144-8d93-e68d91b01199 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:02.785126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecac96-9e40-4a78-9acc-3fec32f720d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:02.786159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecac96-9e40-4a78-9acc-3fec32f720d2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:02.786556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:02.786725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecac96-9e40-4a78-9acc-3fec32f720d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:02.787038 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecac96-9e40-4a78-9acc-3fec32f720d2 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:02.788181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecac96-9e40-4a78-9acc-3fec32f720d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:02.788683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecac96-9e40-4a78-9acc-3fec32f720d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:02.790591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecac96-9e40-4a78-9acc-3fec32f720d2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:02.819725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 404/797] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Aug 10 22:42:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:02.819725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecac96-9e40-4a78-9acc-3fec32f720d2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:02.888579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:02.891817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef53503-9777-4144-8d93-e68d91b01199 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:02.941237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f3aa-ed5f-4dfe-a84e-1722b02dfe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:02.942191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f3aa-ed5f-4dfe-a84e-1722b02dfe6a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:02.942652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f3aa-ed5f-4dfe-a84e-1722b02dfe6a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:02.943107 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f3aa-ed5f-4dfe-a84e-1722b02dfe6a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:02.944038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f3aa-ed5f-4dfe-a84e-1722b02dfe6a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:02.946277 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046f3aa-ed5f-4dfe-a84e-1722b02dfe6a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-8046f3aa-ed5f-4dfe-a84e-1722b02dfe6a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:02.961052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:02.962392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:02.963432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 394/798] 10.222.0.77 () {56 vars in 1129 bytes} [Wed Aug 10 22:42:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:02.964874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5f67-bfee-4280-b48b-8e26ba091e4d None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:02.965080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5f67-bfee-4280-b48b-8e26ba091e4d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:02.965569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a5f67-bfee-4280-b48b-8e26ba091e4d None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:02.974221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 395/799] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:02.974221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5f67-bfee-4280-b48b-8e26ba091e4d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:02.984906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecac96-9e40-4a78-9acc-3fec32f720d2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:03.039658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76dd94-62c3-4a7d-bda7-7e19eec57605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:03.040267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76dd94-62c3-4a7d-bda7-7e19eec57605 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.040544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76dd94-62c3-4a7d-bda7-7e19eec57605 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.040811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76dd94-62c3-4a7d-bda7-7e19eec57605 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.041599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76dd94-62c3-4a7d-bda7-7e19eec57605 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:03.041898 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76dd94-62c3-4a7d-bda7-7e19eec57605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:03.043331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76dd94-62c3-4a7d-bda7-7e19eec57605 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:03.062592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 405/800] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Aug 10 22:42:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:03.063249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76dd94-62c3-4a7d-bda7-7e19eec57605 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:03.103166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:03.122159 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a5f67-bfee-4280-b48b-8e26ba091e4d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:03.188422 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca65e65-cd0f-472d-a48b-2123920248be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:03.189739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca65e65-cd0f-472d-a48b-2123920248be None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.189739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca65e65-cd0f-472d-a48b-2123920248be None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.189739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca65e65-cd0f-472d-a48b-2123920248be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.203581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca65e65-cd0f-472d-a48b-2123920248be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:03.205367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca65e65-cd0f-472d-a48b-2123920248be None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:03.214904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76dd94-62c3-4a7d-bda7-7e19eec57605 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-bca65e65-cd0f-472d-a48b-2123920248be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:03.222123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:03.223919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:03.224813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:03.224813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:03.224813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:03.224813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 396/801] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:03.226102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd39e1-263a-4e8a-be42-e79484eda0e3 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.226102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd39e1-263a-4e8a-be42-e79484eda0e3 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.226280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd39e1-263a-4e8a-be42-e79484eda0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.226804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:03.248632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e8dd39e1-263a-4e8a-be42-e79484eda0e3 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:03.250343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e8dd39e1-263a-4e8a-be42-e79484eda0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:03.261162 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfec38-567e-48ec-8f8e-13a9a02a6159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:03.262265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfec38-567e-48ec-8f8e-13a9a02a6159 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.262477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfec38-567e-48ec-8f8e-13a9a02a6159 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.262693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfec38-567e-48ec-8f8e-13a9a02a6159 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.263640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfec38-567e-48ec-8f8e-13a9a02a6159 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:03.263937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfec38-567e-48ec-8f8e-13a9a02a6159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:03.265312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfec38-567e-48ec-8f8e-13a9a02a6159 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:03.272428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 406/802] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Aug 10 22:42:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:03.273662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfec38-567e-48ec-8f8e-13a9a02a6159 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:03.331849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 397/803] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:03.333436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd39e1-263a-4e8a-be42-e79484eda0e3 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:03.402496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfec38-567e-48ec-8f8e-13a9a02a6159 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:03.437532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:03.442287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e8764-609a-4139-b634-c327be9e238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:03.442932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e8764-609a-4139-b634-c327be9e238a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.443207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e8764-609a-4139-b634-c327be9e238a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.443479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e8764-609a-4139-b634-c327be9e238a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.456321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e8764-609a-4139-b634-c327be9e238a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:03.456321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e8764-609a-4139-b634-c327be9e238a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:03.470304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd39e1-263a-4e8a-be42-e79484eda0e3 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-9a0e8764-609a-4139-b634-c327be9e238a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:03.474396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:03.475372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:03.481640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:03.481640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:03.481640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:03.481640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 407/804] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:03.481640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e8764-609a-4139-b634-c327be9e238a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:03.508369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441c13c-5564-46b3-9666-e7ae96eb856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:03.508990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c13c-5564-46b3-9666-e7ae96eb856d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.509265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c13c-5564-46b3-9666-e7ae96eb856d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.509561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441c13c-5564-46b3-9666-e7ae96eb856d None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.510211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441c13c-5564-46b3-9666-e7ae96eb856d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:03.510509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441c13c-5564-46b3-9666-e7ae96eb856d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:03.511871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441c13c-5564-46b3-9666-e7ae96eb856d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:03.513090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:03.530450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 398/805] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:03.530450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441c13c-5564-46b3-9666-e7ae96eb856d None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:03.623837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e8764-609a-4139-b634-c327be9e238a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:03.657223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441c13c-5564-46b3-9666-e7ae96eb856d None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:03.664075 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9d112-e8ad-4d92-81e9-a22bc179bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:03.664681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9d112-e8ad-4d92-81e9-a22bc179bc6d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.665527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9d112-e8ad-4d92-81e9-a22bc179bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.665798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9d112-e8ad-4d92-81e9-a22bc179bc6d None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.666434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9d112-e8ad-4d92-81e9-a22bc179bc6d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:03.666738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9d112-e8ad-4d92-81e9-a22bc179bc6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:03.668981 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9d112-e8ad-4d92-81e9-a22bc179bc6d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:03.674807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 408/806] 10.222.0.77 () {56 vars in 1124 bytes} [Wed Aug 10 22:42:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:03.675604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9d112-e8ad-4d92-81e9-a22bc179bc6d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:03.695805 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:03.700363 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873d171-ac9d-4fb8-84fb-cd1eb67d49c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:03.701187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873d171-ac9d-4fb8-84fb-cd1eb67d49c6 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.701462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873d171-ac9d-4fb8-84fb-cd1eb67d49c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.701745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873d171-ac9d-4fb8-84fb-cd1eb67d49c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873d171-ac9d-4fb8-84fb-cd1eb67d49c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-c873d171-ac9d-4fb8-84fb-cd1eb67d49c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:03.718665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:03.719555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:03.720444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 399/807] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:42:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:03.721210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873d171-ac9d-4fb8-84fb-cd1eb67d49c6 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:03.770582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:03.785131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9d112-e8ad-4d92-81e9-a22bc179bc6d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:03.821319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f7313-6233-4f4f-9453-f9d8576000bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:03.821935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f7313-6233-4f4f-9453-f9d8576000bf None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.822207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f7313-6233-4f4f-9453-f9d8576000bf None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.822473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f7313-6233-4f4f-9453-f9d8576000bf None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.823101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f7313-6233-4f4f-9453-f9d8576000bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:03.823395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f7313-6233-4f4f-9453-f9d8576000bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:03.824817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f7313-6233-4f4f-9453-f9d8576000bf None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:03.837499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 409/808] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:03.842462 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f7313-6233-4f4f-9453-f9d8576000bf None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:03.846815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873d171-ac9d-4fb8-84fb-cd1eb67d49c6 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:03.882900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1846c57-7a24-47b8-af8b-b8397d7eb623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:03.883532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1846c57-7a24-47b8-af8b-b8397d7eb623 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.883781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1846c57-7a24-47b8-af8b-b8397d7eb623 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.884043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1846c57-7a24-47b8-af8b-b8397d7eb623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.890799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1846c57-7a24-47b8-af8b-b8397d7eb623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:03.892191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1846c57-7a24-47b8-af8b-b8397d7eb623 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-a1846c57-7a24-47b8-af8b-b8397d7eb623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:03.903093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:03.903968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:03.904925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:03.904925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:03.904925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:03.904925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:03.904925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:03.904925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:03.904925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:03.904925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:03.904925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 400/809] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:03.904925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1846c57-7a24-47b8-af8b-b8397d7eb623 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:03.959886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f7313-6233-4f4f-9453-f9d8576000bf None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:03.963928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:03.998002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad722a-5b57-4905-89b0-7b82e3d8aac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:03.998665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad722a-5b57-4905-89b0-7b82e3d8aac9 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:03.998930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad722a-5b57-4905-89b0-7b82e3d8aac9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:03.999142 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad722a-5b57-4905-89b0-7b82e3d8aac9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:03.999806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad722a-5b57-4905-89b0-7b82e3d8aac9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:04.001146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad722a-5b57-4905-89b0-7b82e3d8aac9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:04.012157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1846c57-7a24-47b8-af8b-b8397d7eb623 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:04.047754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edcec1-3311-4a8d-87f2-e736b7e86e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:04.048352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edcec1-3311-4a8d-87f2-e736b7e86e45 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.048631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edcec1-3311-4a8d-87f2-e736b7e86e45 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.048896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edcec1-3311-4a8d-87f2-e736b7e86e45 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.049572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edcec1-3311-4a8d-87f2-e736b7e86e45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:04.049866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edcec1-3311-4a8d-87f2-e736b7e86e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:04.051237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edcec1-3311-4a8d-87f2-e736b7e86e45 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:04.059518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 401/810] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:04.060290 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edcec1-3311-4a8d-87f2-e736b7e86e45 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:04.098642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 410/811] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 22:42:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:42:04.099788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad722a-5b57-4905-89b0-7b82e3d8aac9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:04.112192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:04.168431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edcec1-3311-4a8d-87f2-e736b7e86e45 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:04.184498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:04.215235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c88c8-bdc3-46fc-9b7b-6bb39dcec0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:04.216003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c88c8-bdc3-46fc-9b7b-6bb39dcec0e9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.216316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c88c8-bdc3-46fc-9b7b-6bb39dcec0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.216650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c88c8-bdc3-46fc-9b7b-6bb39dcec0e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.225408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c88c8-bdc3-46fc-9b7b-6bb39dcec0e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:04.226947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c88c8-bdc3-46fc-9b7b-6bb39dcec0e9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:04.233866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad722a-5b57-4905-89b0-7b82e3d8aac9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-aa5c88c8-bdc3-46fc-9b7b-6bb39dcec0e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:04.239771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:04.241000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:04.242256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:04.242256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:04.242256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:04.242256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:04.242256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:04.242256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:04.242256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:04.242256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:04.245739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 402/812] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:04.246876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c88c8-bdc3-46fc-9b7b-6bb39dcec0e9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:04.277621 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821ee66-1d88-42b8-aa20-51b426865621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:04.278155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821ee66-1d88-42b8-aa20-51b426865621 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.279344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821ee66-1d88-42b8-aa20-51b426865621 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.279622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821ee66-1d88-42b8-aa20-51b426865621 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.280316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821ee66-1d88-42b8-aa20-51b426865621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:04.280624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821ee66-1d88-42b8-aa20-51b426865621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:04.282122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821ee66-1d88-42b8-aa20-51b426865621 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:04.296534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 411/813] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:04.297634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ba46-e040-49c0-9d87-ba47259c2514 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.297915 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ba46-e040-49c0-9d87-ba47259c2514 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.298182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ba46-e040-49c0-9d87-ba47259c2514 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.299488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 412/814] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:04.300033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291ba46-e040-49c0-9d87-ba47259c2514 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:04.368592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c88c8-bdc3-46fc-9b7b-6bb39dcec0e9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:04.371558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:04.405572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dd314-f35b-416d-84e6-a54f2228744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:04.406260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dd314-f35b-416d-84e6-a54f2228744a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.406508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dd314-f35b-416d-84e6-a54f2228744a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.406774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dd314-f35b-416d-84e6-a54f2228744a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.414180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291ba46-e040-49c0-9d87-ba47259c2514 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:04.418078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061dd314-f35b-416d-84e6-a54f2228744a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:04.419511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061dd314-f35b-416d-84e6-a54f2228744a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-061dd314-f35b-416d-84e6-a54f2228744a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:04.435526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:04.436565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:04.437497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:04.437497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:04.437497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:04.437497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 403/815] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:04.438284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e28d3e-f444-4155-bcd5-51eb30dbe648 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.438284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e28d3e-f444-4155-bcd5-51eb30dbe648 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.438451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e28d3e-f444-4155-bcd5-51eb30dbe648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.456932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaf995-70ff-43e7-85d2-fc7d8b570b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:04.457914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-82e28d3e-f444-4155-bcd5-51eb30dbe648 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:04.458397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaf995-70ff-43e7-85d2-fc7d8b570b63 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.458676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaf995-70ff-43e7-85d2-fc7d8b570b63 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.458944 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaf995-70ff-43e7-85d2-fc7d8b570b63 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.459110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-82e28d3e-f444-4155-bcd5-51eb30dbe648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:04.459826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eaf995-70ff-43e7-85d2-fc7d8b570b63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:04.460129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eaf995-70ff-43e7-85d2-fc7d8b570b63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:04.461659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eaf995-70ff-43e7-85d2-fc7d8b570b63 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:04.473917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 413/816] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:04.474625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaf995-70ff-43e7-85d2-fc7d8b570b63 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:04.479410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:04.538722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 404/817] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:04.539482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e28d3e-f444-4155-bcd5-51eb30dbe648 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:04.594191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaf995-70ff-43e7-85d2-fc7d8b570b63 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:04.618249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:04.635746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a7402-9ca4-4c2a-80a8-64f0554e45ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:04.636422 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7402-9ca4-4c2a-80a8-64f0554e45ea None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.636697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7402-9ca4-4c2a-80a8-64f0554e45ea None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.636965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a7402-9ca4-4c2a-80a8-64f0554e45ea None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/3500bd875ccf4a3c8302d0f6ce11c12b/roles/4287d802f16f48e99bde5dad08836906` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.656535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a7402-9ca4-4c2a-80a8-64f0554e45ea None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=3500bd875ccf4a3c8302d0f6ce11c12b, role_id=4287d802f16f48e99bde5dad08836906)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:04.660400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a7402-9ca4-4c2a-80a8-64f0554e45ea None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:04.663700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e28d3e-f444-4155-bcd5-51eb30dbe648 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:04.702835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9f31b-a42a-4af8-bdc0-b24c525229ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:04.703438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9f31b-a42a-4af8-bdc0-b24c525229ee None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.703708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9f31b-a42a-4af8-bdc0-b24c525229ee None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.703971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9f31b-a42a-4af8-bdc0-b24c525229ee None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.704610 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9f31b-a42a-4af8-bdc0-b24c525229ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:04.704905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9f31b-a42a-4af8-bdc0-b24c525229ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:04.706301 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9f31b-a42a-4af8-bdc0-b24c525229ee None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:04.720591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 405/818] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:04.721552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9f31b-a42a-4af8-bdc0-b24c525229ee None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:04.737985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:04.748701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 414/819] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:42:04 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/3500bd875ccf4a3c8302d0f6ce11c12b/roles/4287d802f16f48e99bde5dad08836906 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:42:04.749889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a7402-9ca4-4c2a-80a8-64f0554e45ea None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:04.871443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9f31b-a42a-4af8-bdc0-b24c525229ee None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:04.902183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a7402-9ca4-4c2a-80a8-64f0554e45ea None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:04.917121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cca50-41b3-4e93-b2fa-e1aeeda9c821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:04.917121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cca50-41b3-4e93-b2fa-e1aeeda9c821 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.917455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cca50-41b3-4e93-b2fa-e1aeeda9c821 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.917639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cca50-41b3-4e93-b2fa-e1aeeda9c821 None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/6c892a519c8348728d43f0f0d447a321/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.921903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cca50-41b3-4e93-b2fa-e1aeeda9c821 None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=6c892a519c8348728d43f0f0d447a321, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:04.923461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cca50-41b3-4e93-b2fa-e1aeeda9c821 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:04.947712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e29a7-8b11-4d0e-bbfa-47554af04112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:04.948126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e29a7-8b11-4d0e-bbfa-47554af04112 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:04.949018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e29a7-8b11-4d0e-bbfa-47554af04112 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:04.949018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e29a7-8b11-4d0e-bbfa-47554af04112 None admin] PATH_INFO: `/v3/services/network` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:04.949243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e29a7-8b11-4d0e-bbfa-47554af04112 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:04.952071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e29a7-8b11-4d0e-bbfa-47554af04112 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-596e29a7-8b11-4d0e-bbfa-47554af04112 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:04.960251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:04.968977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:04.969824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 415/820] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:04 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:04.970596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e29a7-8b11-4d0e-bbfa-47554af04112 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:04.988965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 406/821] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:42:04 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/6c892a519c8348728d43f0f0d447a321/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:42:04.989894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cca50-41b3-4e93-b2fa-e1aeeda9c821 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:05.012099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:05.072351 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:05.091880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e29a7-8b11-4d0e-bbfa-47554af04112 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:05.109325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cca50-41b3-4e93-b2fa-e1aeeda9c821 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:05.129789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8b95b-d403-4004-8906-b63ec9189a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:05.130761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b95b-d403-4004-8906-b63ec9189a60 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:05.131248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b95b-d403-4004-8906-b63ec9189a60 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:05.131730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b95b-d403-4004-8906-b63ec9189a60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:05.141343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8b95b-d403-4004-8906-b63ec9189a60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:05.143212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8b95b-d403-4004-8906-b63ec9189a60 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:05.148745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb6cdb-8b1f-4818-aded-9b2bcccf8e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:05.149432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb6cdb-8b1f-4818-aded-9b2bcccf8e06 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:05.149713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb6cdb-8b1f-4818-aded-9b2bcccf8e06 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:05.149980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb6cdb-8b1f-4818-aded-9b2bcccf8e06 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:05.150614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb6cdb-8b1f-4818-aded-9b2bcccf8e06 None admin] RBAC: Adding query filter params (name=network) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:05.150910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb6cdb-8b1f-4818-aded-9b2bcccf8e06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:05.152258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb6cdb-8b1f-4818-aded-9b2bcccf8e06 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:05.162516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 407/822] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-86b8b95b-d403-4004-8906-b63ec9189a60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:05.162710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:05.163571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:05.164739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 416/823] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Aug 10 22:42:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:05.171435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8b95b-d403-4004-8906-b63ec9189a60 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:05.171584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb6cdb-8b1f-4818-aded-9b2bcccf8e06 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:05.302617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:05.309997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8b95b-d403-4004-8906-b63ec9189a60 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:05.328256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb6cdb-8b1f-4818-aded-9b2bcccf8e06 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:05.373216 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7338ac-6f8b-4428-8c99-fbdde152b5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:05.375056 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7338ac-6f8b-4428-8c99-fbdde152b5ca None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:05.375571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7338ac-6f8b-4428-8c99-fbdde152b5ca None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:05.377209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7338ac-6f8b-4428-8c99-fbdde152b5ca None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:05.378033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7338ac-6f8b-4428-8c99-fbdde152b5ca None admin] RBAC: Adding query filter params (type=network) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:05.380336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7338ac-6f8b-4428-8c99-fbdde152b5ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:05.381978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7338ac-6f8b-4428-8c99-fbdde152b5ca None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:05.395770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 417/824] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:05.398435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7b54f-e578-47e8-bed7-61a0ac37c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:05.399661 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7338ac-6f8b-4428-8c99-fbdde152b5ca None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:05.401459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7b54f-e578-47e8-bed7-61a0ac37c32c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:05.404393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7b54f-e578-47e8-bed7-61a0ac37c32c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:05.404863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7b54f-e578-47e8-bed7-61a0ac37c32c None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:05.405902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7b54f-e578-47e8-bed7-61a0ac37c32c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:05.407421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7b54f-e578-47e8-bed7-61a0ac37c32c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:05.409418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7b54f-e578-47e8-bed7-61a0ac37c32c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:05.420043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:05.450574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 408/825] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Aug 10 22:42:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:05.455338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7b54f-e578-47e8-bed7-61a0ac37c32c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:05.547483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7338ac-6f8b-4428-8c99-fbdde152b5ca None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:05.582017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7b54f-e578-47e8-bed7-61a0ac37c32c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:05.583541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de842a97-8873-4956-893a-b54e22487d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:05.584376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de842a97-8873-4956-893a-b54e22487d0f None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:05.584850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de842a97-8873-4956-893a-b54e22487d0f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:05.585380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de842a97-8873-4956-893a-b54e22487d0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:05.586266 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de842a97-8873-4956-893a-b54e22487d0f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:05.587857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de842a97-8873-4956-893a-b54e22487d0f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:05.630731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a33bf-5bc5-4f50-9185-41e615eb5a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:05.631281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a33bf-5bc5-4f50-9185-41e615eb5a90 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:05.631557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a33bf-5bc5-4f50-9185-41e615eb5a90 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:05.631823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a33bf-5bc5-4f50-9185-41e615eb5a90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:05.708650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a33bf-5bc5-4f50-9185-41e615eb5a90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:05.710284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a33bf-5bc5-4f50-9185-41e615eb5a90 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:05.830948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 409/826] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:42:05.837594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a33bf-5bc5-4f50-9185-41e615eb5a90 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:05.958753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 418/827] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 22:42:05 2022] POST /identity/v3/endpoints => generated 337 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:42:05.977329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:06.038490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a33bf-5bc5-4f50-9185-41e615eb5a90 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:06.057320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:06.096953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43dd2f-a879-40b4-a494-7ddec157176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:06.098017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43dd2f-a879-40b4-a494-7ddec157176b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:06.098758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43dd2f-a879-40b4-a494-7ddec157176b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:06.099236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43dd2f-a879-40b4-a494-7ddec157176b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:06.111932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43dd2f-a879-40b4-a494-7ddec157176b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:06.113840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43dd2f-a879-40b4-a494-7ddec157176b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-7b43dd2f-a879-40b4-a494-7ddec157176b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:06.137469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:06.138457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:06.139345 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:06.139345 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:06.139345 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:06.141575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 410/828] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:06.147809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de842a97-8873-4956-893a-b54e22487d0f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:06.176231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:06.278245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122c9e8-f47a-41f5-be82-0cbff12a5a99 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:06.278605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122c9e8-f47a-41f5-be82-0cbff12a5a99 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:06.278793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122c9e8-f47a-41f5-be82-0cbff12a5a99 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:06.280183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 411/829] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:06.286026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79a03d-311d-43f8-a751-3562a7f722bb None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:06.286358 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79a03d-311d-43f8-a751-3562a7f722bb None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:06.286583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79a03d-311d-43f8-a751-3562a7f722bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:06.310670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de842a97-8873-4956-893a-b54e22487d0f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:06.318221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-bc79a03d-311d-43f8-a751-3562a7f722bb None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:06.319473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bc79a03d-311d-43f8-a751-3562a7f722bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:06.378034 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7674-924f-4218-b616-fa698822de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:06.378657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7674-924f-4218-b616-fa698822de36 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:06.378991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7674-924f-4218-b616-fa698822de36 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:06.379795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7674-924f-4218-b616-fa698822de36 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:06.380411 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c7674-924f-4218-b616-fa698822de36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:06.380779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c7674-924f-4218-b616-fa698822de36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:06.383052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c7674-924f-4218-b616-fa698822de36 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:06.400838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 419/830] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:06.402952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7674-924f-4218-b616-fa698822de36 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:06.423449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 412/831] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:06.455321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79a03d-311d-43f8-a751-3562a7f722bb None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:06.509842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:06.536208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7674-924f-4218-b616-fa698822de36 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:06.555590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:06.591992 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ebe2f-1435-46e0-9056-296d1c182799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:06.592629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ebe2f-1435-46e0-9056-296d1c182799 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:06.592909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ebe2f-1435-46e0-9056-296d1c182799 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:06.593181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ebe2f-1435-46e0-9056-296d1c182799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:06.606068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ebe2f-1435-46e0-9056-296d1c182799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:06.608013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ebe2f-1435-46e0-9056-296d1c182799 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:06.610799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79a03d-311d-43f8-a751-3562a7f722bb None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-2d7ebe2f-1435-46e0-9056-296d1c182799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:06.623201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:06.624314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:06.625540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:06.625540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:06.625540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:06.625540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:06.625540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:06.625540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:06.625540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:06.625540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:06.628537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 420/832] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:06.632411 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ebe2f-1435-46e0-9056-296d1c182799 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:06.659917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e17f48-452d-4488-9e5b-c0b95d3274f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:06.661672 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e17f48-452d-4488-9e5b-c0b95d3274f8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:06.662289 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e17f48-452d-4488-9e5b-c0b95d3274f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:06.662850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e17f48-452d-4488-9e5b-c0b95d3274f8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:06.663644 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e17f48-452d-4488-9e5b-c0b95d3274f8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:06.665333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e17f48-452d-4488-9e5b-c0b95d3274f8 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-11e17f48-452d-4488-9e5b-c0b95d3274f8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:06.675517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:06.677130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 22:42:06.677983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:06.681010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 413/833] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:42:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:06.687233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e17f48-452d-4488-9e5b-c0b95d3274f8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:06.744496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ebe2f-1435-46e0-9056-296d1c182799 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:06.782397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361465-a572-4636-8803-2122cf131363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:06.783011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361465-a572-4636-8803-2122cf131363 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:06.783294 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361465-a572-4636-8803-2122cf131363 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:06.783567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361465-a572-4636-8803-2122cf131363 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:06.784264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3361465-a572-4636-8803-2122cf131363 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:06.784567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3361465-a572-4636-8803-2122cf131363 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:06.786640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3361465-a572-4636-8803-2122cf131363 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:06.789485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:06.802174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 421/834] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:06.803171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e17f48-452d-4488-9e5b-c0b95d3274f8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:06.807378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361465-a572-4636-8803-2122cf131363 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:06.840954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8ccda-b652-4dc8-adbb-8e3f24cfbbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:06.842042 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8ccda-b652-4dc8-adbb-8e3f24cfbbac None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:06.842518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8ccda-b652-4dc8-adbb-8e3f24cfbbac None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:06.843006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8ccda-b652-4dc8-adbb-8e3f24cfbbac None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:06.843822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8ccda-b652-4dc8-adbb-8e3f24cfbbac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:06.844329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8ccda-b652-4dc8-adbb-8e3f24cfbbac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:06.846183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8ccda-b652-4dc8-adbb-8e3f24cfbbac None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:06.849184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:06.857954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 414/835] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:42:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:06.862462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8ccda-b652-4dc8-adbb-8e3f24cfbbac None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:06.919138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361465-a572-4636-8803-2122cf131363 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:06.956033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdeeec3-e617-42dd-84e8-713c82c5f946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:06.956636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeeec3-e617-42dd-84e8-713c82c5f946 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:06.956914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeeec3-e617-42dd-84e8-713c82c5f946 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:06.957222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeeec3-e617-42dd-84e8-713c82c5f946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:06.958413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdeeec3-e617-42dd-84e8-713c82c5f946 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=34568b830fc641edab39324047368546) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:06.958413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdeeec3-e617-42dd-84e8-713c82c5f946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:06.959805 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdeeec3-e617-42dd-84e8-713c82c5f946 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:06.971224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8ccda-b652-4dc8-adbb-8e3f24cfbbac None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:06.973498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 422/836] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:06 2022] GET /identity/v3/role_assignments?user.id=34568b830fc641edab39324047368546&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=edba0d8c079245a38a321d2d77d25419 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:07.013130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98b788-79bd-4dc8-b14c-52a8dad23981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:07.014169 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b788-79bd-4dc8-b14c-52a8dad23981 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:07.014663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b788-79bd-4dc8-b14c-52a8dad23981 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:07.015198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98b788-79bd-4dc8-b14c-52a8dad23981 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:07.016083 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b788-79bd-4dc8-b14c-52a8dad23981 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:07.016595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b788-79bd-4dc8-b14c-52a8dad23981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:07.018302 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98b788-79bd-4dc8-b14c-52a8dad23981 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:07.025100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 415/837] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:42:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:07.238617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d38c-2cc8-4455-bd0e-d29de040cb25 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:07.239178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d38c-2cc8-4455-bd0e-d29de040cb25 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:07.239178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d38c-2cc8-4455-bd0e-d29de040cb25 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:07.240788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 423/838] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:07.245858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcae34-0bea-4fac-801c-13d47ae50c46 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:07.246142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcae34-0bea-4fac-801c-13d47ae50c46 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:07.246415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcae34-0bea-4fac-801c-13d47ae50c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:07.264444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c9fcae34-0bea-4fac-801c-13d47ae50c46 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:07.265645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c9fcae34-0bea-4fac-801c-13d47ae50c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:07.327686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:07.337014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 416/839] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:07.364076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d38c-2cc8-4455-bd0e-d29de040cb25 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:07.431191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:07.438494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b068a76-f625-4111-a38d-7aefb2c4aedd None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:07.438987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b068a76-f625-4111-a38d-7aefb2c4aedd None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:07.439074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b068a76-f625-4111-a38d-7aefb2c4aedd None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:07.440593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 417/840] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:07.446316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185164e7-37a0-43eb-add1-2cfe59c871a8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:07.446660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185164e7-37a0-43eb-add1-2cfe59c871a8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:07.446933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185164e7-37a0-43eb-add1-2cfe59c871a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:07.465853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-185164e7-37a0-43eb-add1-2cfe59c871a8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:07.467217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-185164e7-37a0-43eb-add1-2cfe59c871a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:07.479549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d38c-2cc8-4455-bd0e-d29de040cb25 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:07.520557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0448a-678f-437f-b85e-ec9ab44aa5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:07.521577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0448a-678f-437f-b85e-ec9ab44aa5ea None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:07.522057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0448a-678f-437f-b85e-ec9ab44aa5ea None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:07.522521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0448a-678f-437f-b85e-ec9ab44aa5ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:07.534245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0448a-678f-437f-b85e-ec9ab44aa5ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-1de0448a-678f-437f-b85e-ec9ab44aa5ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:07.539883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:07.540843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:42:07.541723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:07.543865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 424/841] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:42:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:07.556181 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 418/842] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:07.558609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0448a-678f-437f-b85e-ec9ab44aa5ea None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:07.582968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185164e7-37a0-43eb-add1-2cfe59c871a8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:07.672657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0448a-678f-437f-b85e-ec9ab44aa5ea None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:07.694159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:07.696512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185164e7-37a0-43eb-add1-2cfe59c871a8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:07.709607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa8810-3021-4285-9efd-89117b8436c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:07.710213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa8810-3021-4285-9efd-89117b8436c9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:07.710479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa8810-3021-4285-9efd-89117b8436c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:07.710753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa8810-3021-4285-9efd-89117b8436c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:07.711417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa8810-3021-4285-9efd-89117b8436c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:07.711718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa8810-3021-4285-9efd-89117b8436c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:07.713158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa8810-3021-4285-9efd-89117b8436c9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:07.728305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 425/843] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:42:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:07.729354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa8810-3021-4285-9efd-89117b8436c9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:07.731561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:07.748010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee516c2-7c83-46b1-8b93-e662eaee88f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:07.749271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee516c2-7c83-46b1-8b93-e662eaee88f2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:07.750298 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee516c2-7c83-46b1-8b93-e662eaee88f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:07.750833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee516c2-7c83-46b1-8b93-e662eaee88f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:07.768576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee516c2-7c83-46b1-8b93-e662eaee88f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-0ee516c2-7c83-46b1-8b93-e662eaee88f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:07.775817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:07.777030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:07.777913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:07.781460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 419/844] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:42:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:07.784690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee516c2-7c83-46b1-8b93-e662eaee88f2 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:07.855756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa8810-3021-4285-9efd-89117b8436c9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:07.899507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477007ad-c8e9-40b3-9042-2b58a4e33a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:07.900231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477007ad-c8e9-40b3-9042-2b58a4e33a3b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:07.900511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477007ad-c8e9-40b3-9042-2b58a4e33a3b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:07.900831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477007ad-c8e9-40b3-9042-2b58a4e33a3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:07.911778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477007ad-c8e9-40b3-9042-2b58a4e33a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:07.913147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477007ad-c8e9-40b3-9042-2b58a4e33a3b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:07.922883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee516c2-7c83-46b1-8b93-e662eaee88f2 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-477007ad-c8e9-40b3-9042-2b58a4e33a3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:07.929065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:07.930033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:07.930914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:07.930914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:07.930914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:07.935241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 426/845] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:07.936153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477007ad-c8e9-40b3-9042-2b58a4e33a3b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:07.970878 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa2c8d-e763-441e-80a2-906d9156db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:07.971790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa2c8d-e763-441e-80a2-906d9156db7a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:07.972251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa2c8d-e763-441e-80a2-906d9156db7a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:07.972966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:07.973712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa2c8d-e763-441e-80a2-906d9156db7a None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:07.976040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa2c8d-e763-441e-80a2-906d9156db7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:07.976535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa2c8d-e763-441e-80a2-906d9156db7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:07.978094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa2c8d-e763-441e-80a2-906d9156db7a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:07.990015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 420/846] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:42:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:07.997540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa2c8d-e763-441e-80a2-906d9156db7a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:08.046596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477007ad-c8e9-40b3-9042-2b58a4e33a3b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:08.061669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:08.083966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee34c0-aa63-43d9-92c0-19acefc733ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:08.084772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee34c0-aa63-43d9-92c0-19acefc733ac None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:08.085147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee34c0-aa63-43d9-92c0-19acefc733ac None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:08.085560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee34c0-aa63-43d9-92c0-19acefc733ac None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:08.086494 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee34c0-aa63-43d9-92c0-19acefc733ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:08.086893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee34c0-aa63-43d9-92c0-19acefc733ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:08.088369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee34c0-aa63-43d9-92c0-19acefc733ac None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:08.105931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 427/847] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:08.108531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee34c0-aa63-43d9-92c0-19acefc733ac None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:08.130275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa2c8d-e763-441e-80a2-906d9156db7a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:08.167590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cf761-eb6c-4f99-b4d7-246b480a5eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:08.168464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cf761-eb6c-4f99-b4d7-246b480a5eaf None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:08.169005 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cf761-eb6c-4f99-b4d7-246b480a5eaf None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:08.169443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cf761-eb6c-4f99-b4d7-246b480a5eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:08.182165 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cf761-eb6c-4f99-b4d7-246b480a5eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:08.183856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cf761-eb6c-4f99-b4d7-246b480a5eaf None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-704cf761-eb6c-4f99-b4d7-246b480a5eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:08.200901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:08.202150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:08.203087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:08.203087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:08.203087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:08.205122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 421/848] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:08.212239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cf761-eb6c-4f99-b4d7-246b480a5eaf None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:08.220421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:08.231481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee34c0-aa63-43d9-92c0-19acefc733ac None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:08.278328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27e559-0b07-4d96-8483-ddb02782c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:08.278965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27e559-0b07-4d96-8483-ddb02782c805 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:08.279254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27e559-0b07-4d96-8483-ddb02782c805 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:08.279506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27e559-0b07-4d96-8483-ddb02782c805 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:08.291259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27e559-0b07-4d96-8483-ddb02782c805 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:08.292698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27e559-0b07-4d96-8483-ddb02782c805 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ba27e559-0b07-4d96-8483-ddb02782c805 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:08.312200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:08.313616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:08.314792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:08.314792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:08.314792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:08.314792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:08.314792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:08.314792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:08.314792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:08.314792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:08.314792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:42:08.314792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:08.317835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 428/849] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Aug 10 22:42:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:08.323453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27e559-0b07-4d96-8483-ddb02782c805 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:08.377223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:08.382239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cf761-eb6c-4f99-b4d7-246b480a5eaf None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:08.433283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a03424-6f0f-47ec-b3e0-d9ba46afae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:08.434045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a03424-6f0f-47ec-b3e0-d9ba46afae3a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:08.434302 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a03424-6f0f-47ec-b3e0-d9ba46afae3a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:08.434585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a03424-6f0f-47ec-b3e0-d9ba46afae3a None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:08.435665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a03424-6f0f-47ec-b3e0-d9ba46afae3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:08.435967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a03424-6f0f-47ec-b3e0-d9ba46afae3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:08.437636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a03424-6f0f-47ec-b3e0-d9ba46afae3a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:08.457349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 422/850] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:08.462099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a03424-6f0f-47ec-b3e0-d9ba46afae3a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:08.492770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27e559-0b07-4d96-8483-ddb02782c805 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:08.531001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330497c-d2a1-4508-bbe5-a9b13330249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:08.531265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330497c-d2a1-4508-bbe5-a9b13330249d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:08.531434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330497c-d2a1-4508-bbe5-a9b13330249d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:08.531779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330497c-d2a1-4508-bbe5-a9b13330249d None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:08.532418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330497c-d2a1-4508-bbe5-a9b13330249d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:08.532722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330497c-d2a1-4508-bbe5-a9b13330249d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:08.534244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330497c-d2a1-4508-bbe5-a9b13330249d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:08.557845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 429/851] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Aug 10 22:42:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:08.558807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330497c-d2a1-4508-bbe5-a9b13330249d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:08.574942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:08.670225 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330497c-d2a1-4508-bbe5-a9b13330249d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:08.676640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a03424-6f0f-47ec-b3e0-d9ba46afae3a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:08.708276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25576cda-79f3-4812-8928-559b84fb6094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:08.708874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25576cda-79f3-4812-8928-559b84fb6094 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:08.709143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25576cda-79f3-4812-8928-559b84fb6094 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:08.709447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25576cda-79f3-4812-8928-559b84fb6094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:08.745801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e7523-621f-4673-8099-0d41f085e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:08.747505 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e7523-621f-4673-8099-0d41f085e419 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:08.748259 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e7523-621f-4673-8099-0d41f085e419 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:08.749001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e7523-621f-4673-8099-0d41f085e419 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:08.764486 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e7523-621f-4673-8099-0d41f085e419 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:08.768101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e7523-621f-4673-8099-0d41f085e419 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:08.782692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25576cda-79f3-4812-8928-559b84fb6094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:08.784158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25576cda-79f3-4812-8928-559b84fb6094 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d63e7523-621f-4673-8099-0d41f085e419 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:08.794055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:08.795920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:08.798492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:08.798492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:08.798492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:08.798492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:08.798492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:08.798492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:08.798492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:08.798492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:08.798492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 22:42:08.798492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:08.800709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:08.809740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 423/852] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:42:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:08.813701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e7523-621f-4673-8099-0d41f085e419 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:08.849693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:08.900961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 430/853] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:08 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:42:08.902379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25576cda-79f3-4812-8928-559b84fb6094 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:09.005138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e7523-621f-4673-8099-0d41f085e419 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:09.008158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25576cda-79f3-4812-8928-559b84fb6094 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:09.022879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:09.046623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3589b8a-9154-4872-b439-1e03810ab778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:09.047497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589b8a-9154-4872-b439-1e03810ab778 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.047964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589b8a-9154-4872-b439-1e03810ab778 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.048415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3589b8a-9154-4872-b439-1e03810ab778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.060697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3589b8a-9154-4872-b439-1e03810ab778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:09.062505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3589b8a-9154-4872-b439-1e03810ab778 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:09.072575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b7356-4f95-4a18-bfaa-50bda85c7a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:09.073721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b7356-4f95-4a18-bfaa-50bda85c7a68 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.074280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b7356-4f95-4a18-bfaa-50bda85c7a68 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.074838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b7356-4f95-4a18-bfaa-50bda85c7a68 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.076249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b7356-4f95-4a18-bfaa-50bda85c7a68 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:09.076861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b7356-4f95-4a18-bfaa-50bda85c7a68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:09.079601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b7356-4f95-4a18-bfaa-50bda85c7a68 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f3589b8a-9154-4872-b439-1e03810ab778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:09.080171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:09.081066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:09.082558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:09.082558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:09.082558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:09.089269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 431/854] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:09.090361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3589b8a-9154-4872-b439-1e03810ab778 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:09.121915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 424/855] 10.222.0.77 () {56 vars in 1135 bytes} [Wed Aug 10 22:42:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:09.125333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b7356-4f95-4a18-bfaa-50bda85c7a68 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:09.198069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3589b8a-9154-4872-b439-1e03810ab778 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:09.234455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fbdfa-8a5c-4a0c-b751-76d60059372c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:09.235054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fbdfa-8a5c-4a0c-b751-76d60059372c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.235334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fbdfa-8a5c-4a0c-b751-76d60059372c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.235601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fbdfa-8a5c-4a0c-b751-76d60059372c None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.236279 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fbdfa-8a5c-4a0c-b751-76d60059372c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:09.236591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fbdfa-8a5c-4a0c-b751-76d60059372c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:09.237995 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fbdfa-8a5c-4a0c-b751-76d60059372c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:09.242883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:09.256443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 432/856] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:09.257534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753d629-0077-4a8f-baa9-a2bc26ef4ac4 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.257824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753d629-0077-4a8f-baa9-a2bc26ef4ac4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.258109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753d629-0077-4a8f-baa9-a2bc26ef4ac4 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.259450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 433/857] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:09.260014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753d629-0077-4a8f-baa9-a2bc26ef4ac4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:09.271522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b7356-4f95-4a18-bfaa-50bda85c7a68 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:09.287764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:09.307230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce595701-21ff-4944-9c96-c3d3f83fc0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:09.307834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595701-21ff-4944-9c96-c3d3f83fc0da None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.308113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595701-21ff-4944-9c96-c3d3f83fc0da None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.308378 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce595701-21ff-4944-9c96-c3d3f83fc0da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.372623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753d629-0077-4a8f-baa9-a2bc26ef4ac4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:09.377834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce595701-21ff-4944-9c96-c3d3f83fc0da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:09.379849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce595701-21ff-4944-9c96-c3d3f83fc0da None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:09.408862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996da3-1ddf-447d-8e11-cce24740c736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:09.409853 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996da3-1ddf-447d-8e11-cce24740c736 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.410339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996da3-1ddf-447d-8e11-cce24740c736 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.410812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996da3-1ddf-447d-8e11-cce24740c736 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.418946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996da3-1ddf-447d-8e11-cce24740c736 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:09.421596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca996da3-1ddf-447d-8e11-cce24740c736 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ca996da3-1ddf-447d-8e11-cce24740c736 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:09.436663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:09.437741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:09.439212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:09.439212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:09.439212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:09.439212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:09.439212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:09.439212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:09.439212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:09.439212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:09.442537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 434/858] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:09.444851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ec27-fc78-4887-ba4f-e37680c4136c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.445316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ec27-fc78-4887-ba4f-e37680c4136c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.445740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ec27-fc78-4887-ba4f-e37680c4136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.469166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7df7ec27-fc78-4887-ba4f-e37680c4136c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:09.470406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7df7ec27-fc78-4887-ba4f-e37680c4136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:09.476251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:09.500396 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 425/859] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:09 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 22:42:09.501347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce595701-21ff-4944-9c96-c3d3f83fc0da None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:09.555491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 435/860] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:09.556894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726618c5-3ac3-44ab-b4d4-9f779a8a5dde None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.557269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726618c5-3ac3-44ab-b4d4-9f779a8a5dde None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.557662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726618c5-3ac3-44ab-b4d4-9f779a8a5dde None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.559120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 436/861] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:09.559753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726618c5-3ac3-44ab-b4d4-9f779a8a5dde None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:09.576339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:09.619258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce595701-21ff-4944-9c96-c3d3f83fc0da None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:09.656652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b8d86-b47c-4846-8a06-6fd4711222bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:09.657169 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b8d86-b47c-4846-8a06-6fd4711222bb None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.657483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b8d86-b47c-4846-8a06-6fd4711222bb None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.657753 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b8d86-b47c-4846-8a06-6fd4711222bb None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.658442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b8d86-b47c-4846-8a06-6fd4711222bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:09.658739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b8d86-b47c-4846-8a06-6fd4711222bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:09.660695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b8d86-b47c-4846-8a06-6fd4711222bb None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:09.671573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726618c5-3ac3-44ab-b4d4-9f779a8a5dde None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:09.672840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 426/862] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:09.674117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe973-d995-4541-906f-ab14f83cff49 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.674399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe973-d995-4541-906f-ab14f83cff49 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.674668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fe973-d995-4541-906f-ab14f83cff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.692928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-6a8fe973-d995-4541-906f-ab14f83cff49 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:09.694151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6a8fe973-d995-4541-906f-ab14f83cff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:09.713170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129974a-b016-427e-a448-5d2261d5876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:09.713817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129974a-b016-427e-a448-5d2261d5876a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.714093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129974a-b016-427e-a448-5d2261d5876a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.714359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129974a-b016-427e-a448-5d2261d5876a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.722326 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:09.725424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129974a-b016-427e-a448-5d2261d5876a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:09.726878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129974a-b016-427e-a448-5d2261d5876a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5129974a-b016-427e-a448-5d2261d5876a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:09.743433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:09.744668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:09.745669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:09.745669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:09.745669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:09.745669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 437/863] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:09.745907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129974a-b016-427e-a448-5d2261d5876a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:09.772470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 427/864] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:09.774017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fe973-d995-4541-906f-ab14f83cff49 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:09.827505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:09.864632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129974a-b016-427e-a448-5d2261d5876a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:09.876443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fe973-d995-4541-906f-ab14f83cff49 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:09.897071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3dd35-814d-4c70-a600-d67318f8027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:09.897695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3dd35-814d-4c70-a600-d67318f8027e None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.897969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3dd35-814d-4c70-a600-d67318f8027e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.898239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3dd35-814d-4c70-a600-d67318f8027e None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.898870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3dd35-814d-4c70-a600-d67318f8027e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:09.901138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3dd35-814d-4c70-a600-d67318f8027e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:09.909875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb535a-c130-40a7-adeb-4e3bb4ed93c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:09.910921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb535a-c130-40a7-adeb-4e3bb4ed93c1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:09.911197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb535a-c130-40a7-adeb-4e3bb4ed93c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:09.911464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb535a-c130-40a7-adeb-4e3bb4ed93c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:09.912176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb535a-c130-40a7-adeb-4e3bb4ed93c1 None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=3500bd875ccf4a3c8302d0f6ce11c12b) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:09.912478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb535a-c130-40a7-adeb-4e3bb4ed93c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:09.913923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb535a-c130-40a7-adeb-4e3bb4ed93c1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:09.919506 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 428/865] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:09 2022] GET /identity/v3/role_assignments?user.id=3500bd875ccf4a3c8302d0f6ce11c12b&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:09.920272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb535a-c130-40a7-adeb-4e3bb4ed93c1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:09.953791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:09.977343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 438/866] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:42:09 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:42:09.977343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3dd35-814d-4c70-a600-d67318f8027e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:10.046354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb535a-c130-40a7-adeb-4e3bb4ed93c1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:10.100774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965ab7-0766-4df8-b33e-ede1ef62a8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:10.100774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965ab7-0766-4df8-b33e-ede1ef62a8ee None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:10.100774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965ab7-0766-4df8-b33e-ede1ef62a8ee None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:10.100774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965ab7-0766-4df8-b33e-ede1ef62a8ee None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:10.101502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10965ab7-0766-4df8-b33e-ede1ef62a8ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:10.101812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10965ab7-0766-4df8-b33e-ede1ef62a8ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:10.103333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10965ab7-0766-4df8-b33e-ede1ef62a8ee None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:10.118198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 429/867] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:10.123596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965ab7-0766-4df8-b33e-ede1ef62a8ee None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:10.148316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3dd35-814d-4c70-a600-d67318f8027e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:10.180825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:10.197027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7b4a8-a71b-4508-b492-7f119ac337c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:10.197699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7b4a8-a71b-4508-b492-7f119ac337c5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:10.197975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7b4a8-a71b-4508-b492-7f119ac337c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:10.198246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7b4a8-a71b-4508-b492-7f119ac337c5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:10.198833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7b4a8-a71b-4508-b492-7f119ac337c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:10.200196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7b4a8-a71b-4508-b492-7f119ac337c5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-40c7b4a8-a71b-4508-b492-7f119ac337c5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:10.210354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:10.211527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:10.212409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 439/868] 10.222.0.77 () {56 vars in 1132 bytes} [Wed Aug 10 22:42:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:10.217948 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7b4a8-a71b-4508-b492-7f119ac337c5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:10.255629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:10.276374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965ab7-0766-4df8-b33e-ede1ef62a8ee None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:10.329912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ed3f-6b03-40bb-93bf-8f3efdabf259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:10.330953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ed3f-6b03-40bb-93bf-8f3efdabf259 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:10.331682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ed3f-6b03-40bb-93bf-8f3efdabf259 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:10.332717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ed3f-6b03-40bb-93bf-8f3efdabf259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:10.334975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7b4a8-a71b-4508-b492-7f119ac337c5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:10.341977 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858ed3f-6b03-40bb-93bf-8f3efdabf259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:10.343569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858ed3f-6b03-40bb-93bf-8f3efdabf259 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-3858ed3f-6b03-40bb-93bf-8f3efdabf259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:10.368103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:10.369443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:10.370645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:10.370645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:10.370645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:10.370645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:10.370645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:10.370645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:10.370645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:10.370645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:10.374204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 430/869] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:10.375171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ed3f-6b03-40bb-93bf-8f3efdabf259 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:10.390928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7883-98b8-4adc-a0d6-8bbb7ca18a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:10.391685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7883-98b8-4adc-a0d6-8bbb7ca18a8a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:10.392079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7883-98b8-4adc-a0d6-8bbb7ca18a8a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:10.392446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7883-98b8-4adc-a0d6-8bbb7ca18a8a None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:10.393183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a7883-98b8-4adc-a0d6-8bbb7ca18a8a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:10.393599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a7883-98b8-4adc-a0d6-8bbb7ca18a8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:10.396348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a7883-98b8-4adc-a0d6-8bbb7ca18a8a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:10.404482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 440/870] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:10.410122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7883-98b8-4adc-a0d6-8bbb7ca18a8a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:10.471129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:10.495930 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ed3f-6b03-40bb-93bf-8f3efdabf259 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:10.523769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7883-98b8-4adc-a0d6-8bbb7ca18a8a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:10.542760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2bb97-e78d-4dd6-8fff-96dcd868d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:10.543371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2bb97-e78d-4dd6-8fff-96dcd868d844 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:10.543635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2bb97-e78d-4dd6-8fff-96dcd868d844 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:10.544008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2bb97-e78d-4dd6-8fff-96dcd868d844 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:10.544572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2bb97-e78d-4dd6-8fff-96dcd868d844 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:10.544866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2bb97-e78d-4dd6-8fff-96dcd868d844 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:10.548876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2bb97-e78d-4dd6-8fff-96dcd868d844 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:10.568767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 431/871] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:10.575175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2bb97-e78d-4dd6-8fff-96dcd868d844 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:10.587588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e08a0-d276-49eb-98b7-0786c2c42f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:10.588238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e08a0-d276-49eb-98b7-0786c2c42f43 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:10.588512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e08a0-d276-49eb-98b7-0786c2c42f43 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:10.588776 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e08a0-d276-49eb-98b7-0786c2c42f43 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:10.589441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e08a0-d276-49eb-98b7-0786c2c42f43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:10.589736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e08a0-d276-49eb-98b7-0786c2c42f43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:10.590923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:10.592866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e08a0-d276-49eb-98b7-0786c2c42f43 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:10.603935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 441/872] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:10.708199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2bb97-e78d-4dd6-8fff-96dcd868d844 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:10.747885 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace72305-dc7a-436c-97da-03f945815034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:10.748503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace72305-dc7a-436c-97da-03f945815034 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:10.748778 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace72305-dc7a-436c-97da-03f945815034 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:10.749250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace72305-dc7a-436c-97da-03f945815034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:10.750076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace72305-dc7a-436c-97da-03f945815034 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=6c892a519c8348728d43f0f0d447a321) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:10.750368 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace72305-dc7a-436c-97da-03f945815034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:10.751961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace72305-dc7a-436c-97da-03f945815034 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:10.759893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 432/873] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:10 2022] GET /identity/v3/role_assignments?user.id=6c892a519c8348728d43f0f0d447a321&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=edba0d8c079245a38a321d2d77d25419 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:12.147452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627cd5-703d-4a2f-9929-1eff699b3cf5 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:12.148009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627cd5-703d-4a2f-9929-1eff699b3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:12.148009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627cd5-703d-4a2f-9929-1eff699b3cf5 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:12.149603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 442/874] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:12.155563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e0d26-7f85-4553-93cc-0e8cc7d043a7 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:12.155842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e0d26-7f85-4553-93cc-0e8cc7d043a7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:12.156112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e0d26-7f85-4553-93cc-0e8cc7d043a7 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:12.157369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 443/875] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:12.157994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a838f8-ba89-4ec5-ae23-12b99c6f57c8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:12.158404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a838f8-ba89-4ec5-ae23-12b99c6f57c8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:12.158563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a838f8-ba89-4ec5-ae23-12b99c6f57c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:12.163041 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9c3de-8de7-40cc-b313-2b9e68643035 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:12.163324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9c3de-8de7-40cc-b313-2b9e68643035 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:12.163593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9c3de-8de7-40cc-b313-2b9e68643035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:12.179481 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-53a838f8-ba89-4ec5-ae23-12b99c6f57c8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:12.180669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-53a838f8-ba89-4ec5-ae23-12b99c6f57c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:12.182928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-01e9c3de-8de7-40cc-b313-2b9e68643035 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:12.184078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-01e9c3de-8de7-40cc-b313-2b9e68643035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:12.252999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:12.257848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 433/876] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:12 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:12.267624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 444/877] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:12 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:12.282677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a838f8-ba89-4ec5-ae23-12b99c6f57c8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:12.292001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9c3de-8de7-40cc-b313-2b9e68643035 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:12.364730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:12.398656 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a838f8-ba89-4ec5-ae23-12b99c6f57c8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:12.438464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b828ec-e7e4-43bb-a1c8-1e8cc5d470cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:12.439109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b828ec-e7e4-43bb-a1c8-1e8cc5d470cf None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:12.439381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b828ec-e7e4-43bb-a1c8-1e8cc5d470cf None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:12.439647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b828ec-e7e4-43bb-a1c8-1e8cc5d470cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:12.444968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9c3de-8de7-40cc-b313-2b9e68643035 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:12.451564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b828ec-e7e4-43bb-a1c8-1e8cc5d470cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-c4b828ec-e7e4-43bb-a1c8-1e8cc5d470cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:12.456551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:12.458222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:12.459060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:12.463302 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 434/878] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Aug 10 22:42:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:12.464252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b828ec-e7e4-43bb-a1c8-1e8cc5d470cf None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:12.497708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ead10f-f4f5-4fec-a192-35e51118eccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:12.499367 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ead10f-f4f5-4fec-a192-35e51118eccb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:12.500172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ead10f-f4f5-4fec-a192-35e51118eccb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:12.500652 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ead10f-f4f5-4fec-a192-35e51118eccb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:12.501488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ead10f-f4f5-4fec-a192-35e51118eccb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:12.504361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ead10f-f4f5-4fec-a192-35e51118eccb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-76ead10f-f4f5-4fec-a192-35e51118eccb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:12.516257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:12.517574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 22:42:12.518412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:12.525599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 445/879] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:42:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:12.528204 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ead10f-f4f5-4fec-a192-35e51118eccb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:12.558685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:12.606701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b828ec-e7e4-43bb-a1c8-1e8cc5d470cf None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:12.645936 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37622d79-cf58-4363-965b-e0cc93bdce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:12.646629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37622d79-cf58-4363-965b-e0cc93bdce02 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:12.646901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37622d79-cf58-4363-965b-e0cc93bdce02 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:12.647163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37622d79-cf58-4363-965b-e0cc93bdce02 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:12.647903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37622d79-cf58-4363-965b-e0cc93bdce02 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:12.648147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ead10f-f4f5-4fec-a192-35e51118eccb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:12.648262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37622d79-cf58-4363-965b-e0cc93bdce02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:12.649717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37622d79-cf58-4363-965b-e0cc93bdce02 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:12.663851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 435/880] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Aug 10 22:42:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:12.666239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37622d79-cf58-4363-965b-e0cc93bdce02 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:12.668824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:12.704439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb390ea-a276-476e-aae5-a96b1d3dd9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:12.705312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb390ea-a276-476e-aae5-a96b1d3dd9b7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:12.705620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb390ea-a276-476e-aae5-a96b1d3dd9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:12.705896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb390ea-a276-476e-aae5-a96b1d3dd9b7 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:12.706535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb390ea-a276-476e-aae5-a96b1d3dd9b7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:12.707443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb390ea-a276-476e-aae5-a96b1d3dd9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:12.709655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb390ea-a276-476e-aae5-a96b1d3dd9b7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:12.717353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 446/881] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:42:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:12.722214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb390ea-a276-476e-aae5-a96b1d3dd9b7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:12.805500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37622d79-cf58-4363-965b-e0cc93bdce02 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:12.831149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:12.843756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb390ea-a276-476e-aae5-a96b1d3dd9b7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:12.845025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6028741-0df0-481b-8272-fee7f989354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:12.845942 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6028741-0df0-481b-8272-fee7f989354f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:12.846328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6028741-0df0-481b-8272-fee7f989354f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:12.846698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6028741-0df0-481b-8272-fee7f989354f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:12.859550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6028741-0df0-481b-8272-fee7f989354f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:12.862179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6028741-0df0-481b-8272-fee7f989354f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-a6028741-0df0-481b-8272-fee7f989354f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:12.878021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:12.879749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:12.880723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:12.880723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:12.880723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:12.884710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5822e8-c47f-4376-bd4d-0049e702f7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:12.885528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5822e8-c47f-4376-bd4d-0049e702f7c4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:12.886058 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 436/882] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:12.886310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5822e8-c47f-4376-bd4d-0049e702f7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:12.886726 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5822e8-c47f-4376-bd4d-0049e702f7c4 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:12.887207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6028741-0df0-481b-8272-fee7f989354f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:12.887745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5822e8-c47f-4376-bd4d-0049e702f7c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:12.888203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5822e8-c47f-4376-bd4d-0049e702f7c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:12.889908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5822e8-c47f-4376-bd4d-0049e702f7c4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:12.896479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 447/883] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:42:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:12.905503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5822e8-c47f-4376-bd4d-0049e702f7c4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:12.948206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:12.999792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6028741-0df0-481b-8272-fee7f989354f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:13.012626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5822e8-c47f-4376-bd4d-0049e702f7c4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:13.035701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32fb10-05dd-43b0-83a8-15b8f9971a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:13.036438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32fb10-05dd-43b0-83a8-15b8f9971a86 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.036575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32fb10-05dd-43b0-83a8-15b8f9971a86 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.036835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32fb10-05dd-43b0-83a8-15b8f9971a86 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.037502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32fb10-05dd-43b0-83a8-15b8f9971a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:13.037868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32fb10-05dd-43b0-83a8-15b8f9971a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:13.039235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32fb10-05dd-43b0-83a8-15b8f9971a86 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:13.051138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 437/884] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:13.051454 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dbd11-dce2-465d-a52a-b073fdaa8002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:13.052057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dbd11-dce2-465d-a52a-b073fdaa8002 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.052330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dbd11-dce2-465d-a52a-b073fdaa8002 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.052424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900764-d0ed-4f60-99b0-bd49a6e5c272 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.052601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dbd11-dce2-465d-a52a-b073fdaa8002 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.052697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900764-d0ed-4f60-99b0-bd49a6e5c272 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.052958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900764-d0ed-4f60-99b0-bd49a6e5c272 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.053421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dbd11-dce2-465d-a52a-b073fdaa8002 None admin] RBAC: Adding query filter params (interface=public, service_id=2570ff4eb83044dea187ebc038ae813a, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:13.053623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dbd11-dce2-465d-a52a-b073fdaa8002 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:13.058370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 438/885] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:13.058641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dbd11-dce2-465d-a52a-b073fdaa8002 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:13.058767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03725f20-4005-4a3f-93d5-4f70a8a8419d None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.058767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03725f20-4005-4a3f-93d5-4f70a8a8419d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.058767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03725f20-4005-4a3f-93d5-4f70a8a8419d None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.058767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 439/886] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:13.058767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03725f20-4005-4a3f-93d5-4f70a8a8419d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:13.064954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 448/887] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Aug 10 22:42:12 2022] GET /identity/v3/endpoints?service_id=2570ff4eb83044dea187ebc038ae813a&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:13.065380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5eb1b-7106-43de-b8fa-6ee2491f0d00 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.065664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5eb1b-7106-43de-b8fa-6ee2491f0d00 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.065941 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5eb1b-7106-43de-b8fa-6ee2491f0d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.084511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5bb5eb1b-7106-43de-b8fa-6ee2491f0d00 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:13.085712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5bb5eb1b-7106-43de-b8fa-6ee2491f0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:13.094522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:13.154537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 449/888] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:13.155965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dadb1-5f89-4158-8b00-d794e4cd86f9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.156199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dadb1-5f89-4158-8b00-d794e4cd86f9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.156470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dadb1-5f89-4158-8b00-d794e4cd86f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.174587 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b44dadb1-5f89-4158-8b00-d794e4cd86f9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:13.175791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b44dadb1-5f89-4158-8b00-d794e4cd86f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:13.176550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03725f20-4005-4a3f-93d5-4f70a8a8419d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:13.204379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:13.214174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bde64-4587-4ab9-9679-6bdad878b68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:13.215261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bde64-4587-4ab9-9679-6bdad878b68c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.215261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bde64-4587-4ab9-9679-6bdad878b68c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.215447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bde64-4587-4ab9-9679-6bdad878b68c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.224186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bde64-4587-4ab9-9679-6bdad878b68c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:13.225655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bde64-4587-4ab9-9679-6bdad878b68c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-8f8bde64-4587-4ab9-9679-6bdad878b68c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:13.237669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:13.238772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 440/889] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Aug 10 22:42:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:13.240237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bde64-4587-4ab9-9679-6bdad878b68c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:13.252309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 450/890] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:13.253134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dadb1-5f89-4158-8b00-d794e4cd86f9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:13.358494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:13.365025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bde64-4587-4ab9-9679-6bdad878b68c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:13.369359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dadb1-5f89-4158-8b00-d794e4cd86f9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:13.400906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0224a-dc0e-4838-96ae-9708b2a112f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:13.401524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0224a-dc0e-4838-96ae-9708b2a112f2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.401804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0224a-dc0e-4838-96ae-9708b2a112f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.402065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0224a-dc0e-4838-96ae-9708b2a112f2 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.402655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0224a-dc0e-4838-96ae-9708b2a112f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:13.403984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0224a-dc0e-4838-96ae-9708b2a112f2 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:13.404284 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b16756-baa5-41c2-bb93-6ddbe3ee46cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:13.404945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b16756-baa5-41c2-bb93-6ddbe3ee46cc None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.405158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b16756-baa5-41c2-bb93-6ddbe3ee46cc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.405458 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b16756-baa5-41c2-bb93-6ddbe3ee46cc None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.406146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b16756-baa5-41c2-bb93-6ddbe3ee46cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:13.407429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b16756-baa5-41c2-bb93-6ddbe3ee46cc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:13.409220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 441/891] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Aug 10 22:42:13 2022] GET /identity/v3/services => generated 1011 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 22:42:13.410114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0224a-dc0e-4838-96ae-9708b2a112f2 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:13.521982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 451/892] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:42:13 2022] POST /identity/v3/services => generated 269 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:42:13.523391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b16756-baa5-41c2-bb93-6ddbe3ee46cc None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:13.539855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0224a-dc0e-4838-96ae-9708b2a112f2 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:13.571791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:13.598708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce898bf-1ac6-4b15-9148-23e5cde57860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:13.598708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce898bf-1ac6-4b15-9148-23e5cde57860 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.598708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce898bf-1ac6-4b15-9148-23e5cde57860 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.599145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce898bf-1ac6-4b15-9148-23e5cde57860 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.599860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce898bf-1ac6-4b15-9148-23e5cde57860 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:13.600472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce898bf-1ac6-4b15-9148-23e5cde57860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:13.602593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce898bf-1ac6-4b15-9148-23e5cde57860 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:13.628546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 442/893] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Aug 10 22:42:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:13.634795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce898bf-1ac6-4b15-9148-23e5cde57860 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:13.654281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:13.680964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b16756-baa5-41c2-bb93-6ddbe3ee46cc None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:13.734013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01280b7e-5623-4985-bd56-daa0b87ca748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:13.735009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01280b7e-5623-4985-bd56-daa0b87ca748 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.735493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01280b7e-5623-4985-bd56-daa0b87ca748 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.735988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01280b7e-5623-4985-bd56-daa0b87ca748 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.736767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01280b7e-5623-4985-bd56-daa0b87ca748 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:13.740819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01280b7e-5623-4985-bd56-daa0b87ca748 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-01280b7e-5623-4985-bd56-daa0b87ca748 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:13.751790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:13.752908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:13.754532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 452/894] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:13.763550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01280b7e-5623-4985-bd56-daa0b87ca748 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:13.783442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce898bf-1ac6-4b15-9148-23e5cde57860 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:13.821949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388677ae-ef7f-4c35-9c8b-3b37b8e54397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:13.822841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388677ae-ef7f-4c35-9c8b-3b37b8e54397 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.823267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388677ae-ef7f-4c35-9c8b-3b37b8e54397 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.823779 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388677ae-ef7f-4c35-9c8b-3b37b8e54397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.866213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:13.878874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01280b7e-5623-4985-bd56-daa0b87ca748 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:13.902758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388677ae-ef7f-4c35-9c8b-3b37b8e54397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:13.904533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388677ae-ef7f-4c35-9c8b-3b37b8e54397 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:13.916353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633dfe9-b0d4-44e3-aae6-34320e9a1180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:13.916966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633dfe9-b0d4-44e3-aae6-34320e9a1180 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:13.917239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633dfe9-b0d4-44e3-aae6-34320e9a1180 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:13.917535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633dfe9-b0d4-44e3-aae6-34320e9a1180 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:13.918201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633dfe9-b0d4-44e3-aae6-34320e9a1180 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:13.918510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633dfe9-b0d4-44e3-aae6-34320e9a1180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:13.920695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633dfe9-b0d4-44e3-aae6-34320e9a1180 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:13.923934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:13.930571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 453/895] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Aug 10 22:42:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:13.939412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633dfe9-b0d4-44e3-aae6-34320e9a1180 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:14.021520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 443/896] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:13 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:42:14.027099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388677ae-ef7f-4c35-9c8b-3b37b8e54397 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:14.050051 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633dfe9-b0d4-44e3-aae6-34320e9a1180 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:14.100899 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e15fb4-65a3-4660-bb8d-0caafe981a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:14.101561 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e15fb4-65a3-4660-bb8d-0caafe981a71 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:14.101842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e15fb4-65a3-4660-bb8d-0caafe981a71 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:14.102115 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e15fb4-65a3-4660-bb8d-0caafe981a71 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:14.103060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e15fb4-65a3-4660-bb8d-0caafe981a71 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:14.103370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e15fb4-65a3-4660-bb8d-0caafe981a71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:14.105524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e15fb4-65a3-4660-bb8d-0caafe981a71 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:14.117415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 454/897] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Aug 10 22:42:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:14.162556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388677ae-ef7f-4c35-9c8b-3b37b8e54397 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:14.178383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:14.202020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8f83e-5091-4db2-9885-35ef52362752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:14.202582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8f83e-5091-4db2-9885-35ef52362752 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:14.202855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8f83e-5091-4db2-9885-35ef52362752 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:14.203119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8f83e-5091-4db2-9885-35ef52362752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:14.215697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8f83e-5091-4db2-9885-35ef52362752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:14.217092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8f83e-5091-4db2-9885-35ef52362752 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d5e8f83e-5091-4db2-9885-35ef52362752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:14.234791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:14.235819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:14.237013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:14.237013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:14.237013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:14.237013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 444/898] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:14.242227 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e15fb4-65a3-4660-bb8d-0caafe981a71 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:14.262840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:14.361717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e15fb4-65a3-4660-bb8d-0caafe981a71 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:14.403948 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421bab-2f94-4e3c-9504-3db03a53439d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:14.404836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421bab-2f94-4e3c-9504-3db03a53439d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:14.405389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421bab-2f94-4e3c-9504-3db03a53439d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:14.405809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69421bab-2f94-4e3c-9504-3db03a53439d None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:14.406633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69421bab-2f94-4e3c-9504-3db03a53439d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:14.407088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69421bab-2f94-4e3c-9504-3db03a53439d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:14.408615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69421bab-2f94-4e3c-9504-3db03a53439d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:14.425016 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 455/899] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:14.430722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8f83e-5091-4db2-9885-35ef52362752 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:14.543349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8f83e-5091-4db2-9885-35ef52362752 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:14.581141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4838482-8d39-4521-8804-f911d1888b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:14.581834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838482-8d39-4521-8804-f911d1888b18 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:14.582112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838482-8d39-4521-8804-f911d1888b18 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:14.582377 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838482-8d39-4521-8804-f911d1888b18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:14.589711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4838482-8d39-4521-8804-f911d1888b18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:14.591214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4838482-8d39-4521-8804-f911d1888b18 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-e4838482-8d39-4521-8804-f911d1888b18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:14.604003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:14.605173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:14.606123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:14.606123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:14.606123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:14.606123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:14.606123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:14.606123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:14.606123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:14.606123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:14.606123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 445/900] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:14.611325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421bab-2f94-4e3c-9504-3db03a53439d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:14.695161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:14.718978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69421bab-2f94-4e3c-9504-3db03a53439d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:14.755060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ef75f-5a56-4cdc-bd91-94c6a7fe38be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:14.755707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ef75f-5a56-4cdc-bd91-94c6a7fe38be None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:14.755982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ef75f-5a56-4cdc-bd91-94c6a7fe38be None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:14.756248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ef75f-5a56-4cdc-bd91-94c6a7fe38be None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:14.756935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ef75f-5a56-4cdc-bd91-94c6a7fe38be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:14.757234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ef75f-5a56-4cdc-bd91-94c6a7fe38be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:14.758683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ef75f-5a56-4cdc-bd91-94c6a7fe38be None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:14.771130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 456/901] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:14.777119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4838482-8d39-4521-8804-f911d1888b18 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:14.804469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:14.889118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4838482-8d39-4521-8804-f911d1888b18 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:14.924373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dc374-83f3-4ddf-a4ee-942dc32fab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:14.924974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dc374-83f3-4ddf-a4ee-942dc32fab43 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:14.925248 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dc374-83f3-4ddf-a4ee-942dc32fab43 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:14.926129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dc374-83f3-4ddf-a4ee-942dc32fab43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:14.926842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dc374-83f3-4ddf-a4ee-942dc32fab43 None admin] RBAC: Adding query filter params (role.id=0de4cd838d5c4fc1accf3463cffd2283, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=3500bd875ccf4a3c8302d0f6ce11c12b) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:14.927201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dc374-83f3-4ddf-a4ee-942dc32fab43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:14.928623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dc374-83f3-4ddf-a4ee-942dc32fab43 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:14.934824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 446/902] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:14 2022] GET /identity/v3/role_assignments?user.id=3500bd875ccf4a3c8302d0f6ce11c12b&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=0de4cd838d5c4fc1accf3463cffd2283 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:15.509461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c655c1f-bc89-48d2-9eae-460dd8087b50 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:15.510011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c655c1f-bc89-48d2-9eae-460dd8087b50 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:15.510362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c655c1f-bc89-48d2-9eae-460dd8087b50 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:15.512751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 457/903] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:15.518339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec42ea-1573-4969-b80d-a4bb41187192 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:15.518901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec42ea-1573-4969-b80d-a4bb41187192 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:15.518901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec42ea-1573-4969-b80d-a4bb41187192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:15.551097 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-01ec42ea-1573-4969-b80d-a4bb41187192 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:15.551538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-01ec42ea-1573-4969-b80d-a4bb41187192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:15.643036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 447/904] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:15.666890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c655c1f-bc89-48d2-9eae-460dd8087b50 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:15.782660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c655c1f-bc89-48d2-9eae-460dd8087b50 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:15.809538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774777d-514a-4a9e-91a7-5e44cc8df393 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:15.809962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774777d-514a-4a9e-91a7-5e44cc8df393 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:15.810299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774777d-514a-4a9e-91a7-5e44cc8df393 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:15.811694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 448/905] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:15.820660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ecf4e-a308-42be-897d-a8f94b8bb46f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:15.821339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ecf4e-a308-42be-897d-a8f94b8bb46f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:15.821835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ecf4e-a308-42be-897d-a8f94b8bb46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:15.827872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb37f87-8327-4ff6-979a-2c94b2b8fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:15.828578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb37f87-8327-4ff6-979a-2c94b2b8fba3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:15.828852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb37f87-8327-4ff6-979a-2c94b2b8fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:15.829120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb37f87-8327-4ff6-979a-2c94b2b8fba3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:15.829748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb37f87-8327-4ff6-979a-2c94b2b8fba3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:15.832530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb37f87-8327-4ff6-979a-2c94b2b8fba3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:15.835585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5bb37f87-8327-4ff6-979a-2c94b2b8fba3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:15.844997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:15.848818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 22:42:15.850080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:15.850810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-490ecf4e-a308-42be-897d-a8f94b8bb46f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:15.850810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-490ecf4e-a308-42be-897d-a8f94b8bb46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:15.850955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 458/906] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:42:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:15.857639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb37f87-8327-4ff6-979a-2c94b2b8fba3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:15.877674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:15.927174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 449/907] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:15.967208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ecf4e-a308-42be-897d-a8f94b8bb46f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:15.993363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb37f87-8327-4ff6-979a-2c94b2b8fba3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:16.031085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02d1ed-de72-4438-a43a-972104947e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:16.031696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d1ed-de72-4438-a43a-972104947e8e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:16.031962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d1ed-de72-4438-a43a-972104947e8e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:16.032235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d1ed-de72-4438-a43a-972104947e8e None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:16.033006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02d1ed-de72-4438-a43a-972104947e8e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:16.033229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02d1ed-de72-4438-a43a-972104947e8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:16.034655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02d1ed-de72-4438-a43a-972104947e8e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:16.045173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 459/908] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:42:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:16.046189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02d1ed-de72-4438-a43a-972104947e8e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:16.124458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ecf4e-a308-42be-897d-a8f94b8bb46f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:16.129779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:16.162478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e9ca-786c-49fe-bf02-fbf153e53515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:16.163110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e9ca-786c-49fe-bf02-fbf153e53515 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:16.163385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e9ca-786c-49fe-bf02-fbf153e53515 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:16.163652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e9ca-786c-49fe-bf02-fbf153e53515 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:16.164249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44e9ca-786c-49fe-bf02-fbf153e53515 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:16.166015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44e9ca-786c-49fe-bf02-fbf153e53515 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5c44e9ca-786c-49fe-bf02-fbf153e53515 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:16.176070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:16.177596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 22:42:16.178479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:16.183253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 450/909] 10.222.0.77 () {56 vars in 1132 bytes} [Wed Aug 10 22:42:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:16.184295 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e9ca-786c-49fe-bf02-fbf153e53515 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:16.201604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:16.206424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02d1ed-de72-4438-a43a-972104947e8e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:16.248550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e912-4bc2-4d89-a139-c7e52a91f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:16.249719 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e912-4bc2-4d89-a139-c7e52a91f8da None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:16.250446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e912-4bc2-4d89-a139-c7e52a91f8da None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:16.250941 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4e912-4bc2-4d89-a139-c7e52a91f8da None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:16.251771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e912-4bc2-4d89-a139-c7e52a91f8da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:16.252267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e912-4bc2-4d89-a139-c7e52a91f8da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:16.254852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4e912-4bc2-4d89-a139-c7e52a91f8da None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:16.261133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 460/910] 10.222.0.77 () {56 vars in 1114 bytes} [Wed Aug 10 22:42:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:16.267105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e912-4bc2-4d89-a139-c7e52a91f8da None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:16.322469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e9ca-786c-49fe-bf02-fbf153e53515 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:16.360496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb607aa2-786a-463e-b164-17654fc13c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:16.361129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb607aa2-786a-463e-b164-17654fc13c5b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:16.366991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb607aa2-786a-463e-b164-17654fc13c5b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:16.366991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb607aa2-786a-463e-b164-17654fc13c5b None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:16.366991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb607aa2-786a-463e-b164-17654fc13c5b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:16.366991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb607aa2-786a-463e-b164-17654fc13c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:16.366991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb607aa2-786a-463e-b164-17654fc13c5b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:16.370123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 451/911] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:16.371362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab55df-177a-4a77-ae80-58587bd2a0c4 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:16.371638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab55df-177a-4a77-ae80-58587bd2a0c4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:16.371903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab55df-177a-4a77-ae80-58587bd2a0c4 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:16.373414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 452/912] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:16.382260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a80b-41ef-43a3-ad57-31094c499c12 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:16.382591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a80b-41ef-43a3-ad57-31094c499c12 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:16.382801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286a80b-41ef-43a3-ad57-31094c499c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:16.401517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e286a80b-41ef-43a3-ad57-31094c499c12 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:16.402619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e286a80b-41ef-43a3-ad57-31094c499c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:16.407879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4e912-4bc2-4d89-a139-c7e52a91f8da None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:16.444823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:16.458938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8351f6-ad0c-4059-a1a8-19cfb7466aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:16.459745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8351f6-ad0c-4059-a1a8-19cfb7466aac None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:16.460208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8351f6-ad0c-4059-a1a8-19cfb7466aac None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:16.461009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8351f6-ad0c-4059-a1a8-19cfb7466aac None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:16.461698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8351f6-ad0c-4059-a1a8-19cfb7466aac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:16.465533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8351f6-ad0c-4059-a1a8-19cfb7466aac None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:16.495653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 453/913] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:16.496938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286a80b-41ef-43a3-ad57-31094c499c12 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:16.510593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:16.587709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 461/914] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 22:42:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:42:16.587709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8351f6-ad0c-4059-a1a8-19cfb7466aac None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:16.629340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286a80b-41ef-43a3-ad57-31094c499c12 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:16.703796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe288abc-fa6c-4337-8fae-68fe6b952c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:16.704686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe288abc-fa6c-4337-8fae-68fe6b952c2c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:16.705098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe288abc-fa6c-4337-8fae-68fe6b952c2c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:16.705557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe288abc-fa6c-4337-8fae-68fe6b952c2c None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:16.706538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe288abc-fa6c-4337-8fae-68fe6b952c2c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:16.707047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe288abc-fa6c-4337-8fae-68fe6b952c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:16.709523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe288abc-fa6c-4337-8fae-68fe6b952c2c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:16.724360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 454/915] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:16.726232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe288abc-fa6c-4337-8fae-68fe6b952c2c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:16.752655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8351f6-ad0c-4059-a1a8-19cfb7466aac None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:16.808850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f469f-4503-4c31-a307-36b513451eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:16.809594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f469f-4503-4c31-a307-36b513451eaf None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:16.810021 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f469f-4503-4c31-a307-36b513451eaf None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:16.810471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f469f-4503-4c31-a307-36b513451eaf None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:16.811577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f469f-4503-4c31-a307-36b513451eaf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:16.813632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f469f-4503-4c31-a307-36b513451eaf None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:16.850583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:16.882610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 462/916] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:42:16 2022] POST /identity/v3/services => generated 241 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:42:16.898521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe288abc-fa6c-4337-8fae-68fe6b952c2c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:16.971140 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfd639-7018-4f75-8405-56e5664a8508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:16.972143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfd639-7018-4f75-8405-56e5664a8508 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:16.973482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfd639-7018-4f75-8405-56e5664a8508 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:16.973988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfd639-7018-4f75-8405-56e5664a8508 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:16.974949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfd639-7018-4f75-8405-56e5664a8508 None admin] RBAC: Adding query filter params (interface=public, service_id=a125f6ed63c4430dab24c027296397f0, region_id=RegionOne) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:16.975494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfd639-7018-4f75-8405-56e5664a8508 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:16.977201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfd639-7018-4f75-8405-56e5664a8508 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:16.983785 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 455/917] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Aug 10 22:42:16 2022] GET /identity/v3/endpoints?service_id=a125f6ed63c4430dab24c027296397f0&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:16.997370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f469f-4503-4c31-a307-36b513451eaf None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:17.037747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a4a24-f82e-485d-a671-70e60b7ce08f None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:17.038752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a4a24-f82e-485d-a671-70e60b7ce08f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:17.039368 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a4a24-f82e-485d-a671-70e60b7ce08f None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:17.041680 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 456/918] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:17.046912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045c98-caaf-4310-83b7-fa13693dcf38 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:17.047557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045c98-caaf-4310-83b7-fa13693dcf38 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:17.048028 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045c98-caaf-4310-83b7-fa13693dcf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:17.048363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:17.071803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-53045c98-caaf-4310-83b7-fa13693dcf38 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:17.073366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-53045c98-caaf-4310-83b7-fa13693dcf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:17.116777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f469f-4503-4c31-a307-36b513451eaf None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:17.164658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35800f63-4ef1-44f0-9a91-79193ed81598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:17.165578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35800f63-4ef1-44f0-9a91-79193ed81598 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:17.166042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35800f63-4ef1-44f0-9a91-79193ed81598 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:17.166506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35800f63-4ef1-44f0-9a91-79193ed81598 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:17.167721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35800f63-4ef1-44f0-9a91-79193ed81598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:17.170367 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35800f63-4ef1-44f0-9a91-79193ed81598 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:17.178710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 457/919] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:17.185349 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 463/920] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Aug 10 22:42:16 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 22:42:17.202502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53045c98-caaf-4310-83b7-fa13693dcf38 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:17.275416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:17.332321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53045c98-caaf-4310-83b7-fa13693dcf38 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:17.380210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be8a7-c157-4e7c-b5d0-7ff9fdcdfa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:17.380826 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be8a7-c157-4e7c-b5d0-7ff9fdcdfa71 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:17.381104 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be8a7-c157-4e7c-b5d0-7ff9fdcdfa71 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:17.381400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be8a7-c157-4e7c-b5d0-7ff9fdcdfa71 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:17.392968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38be8a7-c157-4e7c-b5d0-7ff9fdcdfa71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-c38be8a7-c157-4e7c-b5d0-7ff9fdcdfa71 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:17.398311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:17.399401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:17.400252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 458/921] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Aug 10 22:42:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:17.405367 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35800f63-4ef1-44f0-9a91-79193ed81598 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:17.520799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35800f63-4ef1-44f0-9a91-79193ed81598 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:17.531342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:17.561181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffd635-475a-4d2d-aec9-011ed0e956ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:17.561829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffd635-475a-4d2d-aec9-011ed0e956ab None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:17.562102 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffd635-475a-4d2d-aec9-011ed0e956ab None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:17.562369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffd635-475a-4d2d-aec9-011ed0e956ab None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:17.563120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffd635-475a-4d2d-aec9-011ed0e956ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:17.563418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffd635-475a-4d2d-aec9-011ed0e956ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:17.564799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffd635-475a-4d2d-aec9-011ed0e956ab None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:17.575837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 464/922] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Aug 10 22:42:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:17.582635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be8a7-c157-4e7c-b5d0-7ff9fdcdfa71 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:17.707230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be8a7-c157-4e7c-b5d0-7ff9fdcdfa71 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:17.725665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:17.745243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0e4f-b458-4181-a0f8-084490c1eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:17.745910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0e4f-b458-4181-a0f8-084490c1eec6 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:17.746188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0e4f-b458-4181-a0f8-084490c1eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:17.746453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0e4f-b458-4181-a0f8-084490c1eec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:17.760093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0e4f-b458-4181-a0f8-084490c1eec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:17.761587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0e4f-b458-4181-a0f8-084490c1eec6 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-ca4d0e4f-b458-4181-a0f8-084490c1eec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:17.778542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:17.780669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:17.782106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:17.782106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:17.782106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:17.782106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 459/923] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:17.787435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffd635-475a-4d2d-aec9-011ed0e956ab None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:17.903118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffd635-475a-4d2d-aec9-011ed0e956ab None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:17.942044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca948394-6399-4916-b18b-a8fbdf3d85ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:17.942658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca948394-6399-4916-b18b-a8fbdf3d85ec None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:17.942929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca948394-6399-4916-b18b-a8fbdf3d85ec None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:17.943193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca948394-6399-4916-b18b-a8fbdf3d85ec None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:17.943837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca948394-6399-4916-b18b-a8fbdf3d85ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:17.944137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca948394-6399-4916-b18b-a8fbdf3d85ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:17.945540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca948394-6399-4916-b18b-a8fbdf3d85ec None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:17.958967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 465/924] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:17.966525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0e4f-b458-4181-a0f8-084490c1eec6 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:18.076661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0e4f-b458-4181-a0f8-084490c1eec6 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:18.114354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19282af5-b0dd-4f9c-a3af-f558f79455a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:18.115032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19282af5-b0dd-4f9c-a3af-f558f79455a9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:18.115320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19282af5-b0dd-4f9c-a3af-f558f79455a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:18.115592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19282af5-b0dd-4f9c-a3af-f558f79455a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:18.126181 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19282af5-b0dd-4f9c-a3af-f558f79455a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:18.127868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19282af5-b0dd-4f9c-a3af-f558f79455a9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-19282af5-b0dd-4f9c-a3af-f558f79455a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:18.140541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:18.141789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:18.142955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 460/925] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Aug 10 22:42:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:18.150418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca948394-6399-4916-b18b-a8fbdf3d85ec None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:18.189693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:18.266035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca948394-6399-4916-b18b-a8fbdf3d85ec None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:18.301571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5941c-1366-414f-8498-5091cb52578a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:18.302176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5941c-1366-414f-8498-5091cb52578a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:18.302451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5941c-1366-414f-8498-5091cb52578a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:18.302720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5941c-1366-414f-8498-5091cb52578a None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:18.303445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5941c-1366-414f-8498-5091cb52578a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:18.303751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5941c-1366-414f-8498-5091cb52578a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:18.305179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5941c-1366-414f-8498-5091cb52578a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:18.325262 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 466/926] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Aug 10 22:42:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:18.330894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19282af5-b0dd-4f9c-a3af-f558f79455a9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:18.365312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:18.448585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19282af5-b0dd-4f9c-a3af-f558f79455a9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:18.485099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28840e0-212e-4801-8f82-19563a9351f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:18.485782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28840e0-212e-4801-8f82-19563a9351f1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:18.486053 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28840e0-212e-4801-8f82-19563a9351f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:18.486322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28840e0-212e-4801-8f82-19563a9351f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:18.498611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28840e0-212e-4801-8f82-19563a9351f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:18.500056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28840e0-212e-4801-8f82-19563a9351f1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-e28840e0-212e-4801-8f82-19563a9351f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:18.515376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:18.516425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:18.517356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:18.517356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:18.517356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:18.517356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 461/927] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:18.523866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5941c-1366-414f-8498-5091cb52578a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:18.640045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:18.662422 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5941c-1366-414f-8498-5091cb52578a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:18.701169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbb459-171f-4131-a843-0d478c76f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:18.701810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbb459-171f-4131-a843-0d478c76f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:18.702089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbb459-171f-4131-a843-0d478c76f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:18.702359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbb459-171f-4131-a843-0d478c76f3f6 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:18.703008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbb459-171f-4131-a843-0d478c76f3f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:18.703307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbb459-171f-4131-a843-0d478c76f3f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:18.704748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbb459-171f-4131-a843-0d478c76f3f6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:18.717426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 467/928] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:18.724068 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28840e0-212e-4801-8f82-19563a9351f1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:18.836130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:18.858466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28840e0-212e-4801-8f82-19563a9351f1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:18.896787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d4abc-e04f-4f2e-b4e9-37dc33940e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:18.897451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d4abc-e04f-4f2e-b4e9-37dc33940e06 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:18.897723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d4abc-e04f-4f2e-b4e9-37dc33940e06 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:18.897991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d4abc-e04f-4f2e-b4e9-37dc33940e06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:18.905436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d4abc-e04f-4f2e-b4e9-37dc33940e06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:18.906884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d4abc-e04f-4f2e-b4e9-37dc33940e06 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-800d4abc-e04f-4f2e-b4e9-37dc33940e06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:18.919459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:18.920433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:18.921374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:18.921374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:18.921374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:18.921374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:18.921374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:18.921374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:18.921374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:18.921374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:18.921374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 462/929] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:18.928947 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbb459-171f-4131-a843-0d478c76f3f6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:19.053690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbb459-171f-4131-a843-0d478c76f3f6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:19.095887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16434aa3-ab7b-47c5-9fdb-65efdab4b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:19.096502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16434aa3-ab7b-47c5-9fdb-65efdab4b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.096836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16434aa3-ab7b-47c5-9fdb-65efdab4b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.097124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16434aa3-ab7b-47c5-9fdb-65efdab4b9c3 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.098690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16434aa3-ab7b-47c5-9fdb-65efdab4b9c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:19.098993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16434aa3-ab7b-47c5-9fdb-65efdab4b9c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:19.100459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16434aa3-ab7b-47c5-9fdb-65efdab4b9c3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:19.114235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 468/930] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:19.120188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d4abc-e04f-4f2e-b4e9-37dc33940e06 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:19.183517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a464f-9952-4012-b7f7-3076fd07a7bf None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.183858 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a464f-9952-4012-b7f7-3076fd07a7bf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.184048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a464f-9952-4012-b7f7-3076fd07a7bf None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.186016 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 469/931] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:19.192163 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca88c0-1da7-498f-b3e2-c52e0ccfcff2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.192590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca88c0-1da7-498f-b3e2-c52e0ccfcff2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.193040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca88c0-1da7-498f-b3e2-c52e0ccfcff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.217175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c0ca88c0-1da7-498f-b3e2-c52e0ccfcff2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:19.219565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c0ca88c0-1da7-498f-b3e2-c52e0ccfcff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:19.225651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:19.248770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d4abc-e04f-4f2e-b4e9-37dc33940e06 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:19.296364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d464c-2043-43ae-bd61-368fb931f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:19.297032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d464c-2043-43ae-bd61-368fb931f5e5 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.297391 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d464c-2043-43ae-bd61-368fb931f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.297601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d464c-2043-43ae-bd61-368fb931f5e5 None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/3500bd875ccf4a3c8302d0f6ce11c12b/roles/0de4cd838d5c4fc1accf3463cffd2283` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.300037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d464c-2043-43ae-bd61-368fb931f5e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=3500bd875ccf4a3c8302d0f6ce11c12b, role_id=0de4cd838d5c4fc1accf3463cffd2283)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:19.301267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d464c-2043-43ae-bd61-368fb931f5e5 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:19.308577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 470/932] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:19.310046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe912e2e-a519-4ea0-8b02-7c2f22d65654 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.310329 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe912e2e-a519-4ea0-8b02-7c2f22d65654 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.310609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe912e2e-a519-4ea0-8b02-7c2f22d65654 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.312064 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 471/933] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:19.318211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d761b69-88e8-43f1-a19a-35459ab88581 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.318211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d761b69-88e8-43f1-a19a-35459ab88581 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.318211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d761b69-88e8-43f1-a19a-35459ab88581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.338283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5d761b69-88e8-43f1-a19a-35459ab88581 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:19.339131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5d761b69-88e8-43f1-a19a-35459ab88581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:19.402670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:19.407331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 463/934] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:42:19 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/3500bd875ccf4a3c8302d0f6ce11c12b/roles/0de4cd838d5c4fc1accf3463cffd2283 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:42:19.418320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d464c-2043-43ae-bd61-368fb931f5e5 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:19.438277 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 472/935] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:19.476536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d761b69-88e8-43f1-a19a-35459ab88581 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:19.566470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d464c-2043-43ae-bd61-368fb931f5e5 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:19.572058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:19.613319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f32de-e95f-4224-9f56-13dc52de7703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:19.614187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f32de-e95f-4224-9f56-13dc52de7703 None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.614456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f32de-e95f-4224-9f56-13dc52de7703 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.614717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f32de-e95f-4224-9f56-13dc52de7703 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.615365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f32de-e95f-4224-9f56-13dc52de7703 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:19.615470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d761b69-88e8-43f1-a19a-35459ab88581 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:19.616789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f32de-e95f-4224-9f56-13dc52de7703 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:19.622731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WARNING keystone.server.flask.common [None req-859f32de-e95f-4224-9f56-13dc52de7703 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 22:42:19.658077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc10dc-4176-4820-8a92-b78b8158f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:19.658623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc10dc-4176-4820-8a92-b78b8158f94f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.658899 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc10dc-4176-4820-8a92-b78b8158f94f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.659170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc10dc-4176-4820-8a92-b78b8158f94f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.659774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc10dc-4176-4820-8a92-b78b8158f94f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:19.661138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc10dc-4176-4820-8a92-b78b8158f94f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:19.667745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.sql.core [None req-859f32de-e95f-4224-9f56-13dc52de7703 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 22:42:19.667745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 22:42:19.667745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [parameters: {'id': 'd573e607e43d43c4b1bf7feb769a2b71', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 22:42:19.667745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93407) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a7bc10dc-4176-4820-8a92-b78b8158f94f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:19.669999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:19.671175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:19.672209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 473/936] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:19.673177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1d5aa-3bfa-438e-8122-0844fb738ae5 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.673177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1d5aa-3bfa-438e-8122-0844fb738ae5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.673177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1d5aa-3bfa-438e-8122-0844fb738ae5 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.674366 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 474/937] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:19.681901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1d5aa-3bfa-438e-8122-0844fb738ae5 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-859f32de-e95f-4224-9f56-13dc52de7703 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d573e607e43d43c4b1bf7feb769a2b71.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d573e607e43d43c4b1bf7feb769a2b71. Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application conn.query(q) Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 22:42:19.689410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application result.read() Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 10 22:42:19.690404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application next(self.gen) Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application yield resource Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application next(self.gen) Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise self.value Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application session.commit() Aug 10 22:42:19.692236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self.session.flush() Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application compat.raise_( Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 22:42:19.693139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 22:42:19.702207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application conn.query(q) Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application result.read() Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 22:42:19.704212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [parameters: {'id': 'd573e607e43d43c4b1bf7feb769a2b71', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:19.705511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:19.707346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d573e607e43d43c4b1bf7feb769a2b71. Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 464/938] 10.222.0.77 () {60 vars in 1140 bytes} [Wed Aug 10 22:42:19 2022] POST /identity/v3/projects => generated 262 bytes in 284 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c229-274f-4600-be35-9e4db783b227 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.708524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c229-274f-4600-be35-9e4db783b227 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.709665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c229-274f-4600-be35-9e4db783b227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.719950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-dae8c229-274f-4600-be35-9e4db783b227 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:19.721499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-dae8c229-274f-4600-be35-9e4db783b227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:19.787137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:19.805629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 465/939] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:19.806493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8c229-274f-4600-be35-9e4db783b227 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:19.830229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1d5aa-3bfa-438e-8122-0844fb738ae5 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:19.865862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:19.871743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a61964-c2d9-4179-871d-774478b5e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:19.872362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a61964-c2d9-4179-871d-774478b5e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.872634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a61964-c2d9-4179-871d-774478b5e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.872904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a61964-c2d9-4179-871d-774478b5e2e7 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.873651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a61964-c2d9-4179-871d-774478b5e2e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:19.873969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a61964-c2d9-4179-871d-774478b5e2e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:19.875371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a61964-c2d9-4179-871d-774478b5e2e7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:19.881328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 475/940] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Aug 10 22:42:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:19.882042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a61964-c2d9-4179-871d-774478b5e2e7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:19.920957 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8c229-274f-4600-be35-9e4db783b227 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:19.956260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b25c6-eeff-48a2-98c4-06de81dbf4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:19.956935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b25c6-eeff-48a2-98c4-06de81dbf4a8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:19.957202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b25c6-eeff-48a2-98c4-06de81dbf4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:19.957493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b25c6-eeff-48a2-98c4-06de81dbf4a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:19.965772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b25c6-eeff-48a2-98c4-06de81dbf4a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:19.967419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b25c6-eeff-48a2-98c4-06de81dbf4a8 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-728b25c6-eeff-48a2-98c4-06de81dbf4a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:19.979489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:19.980409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:19.981973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:19.981973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:19.981973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:19.981973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:19.981973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:19.981973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:19.981973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:19.981973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:19.981973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 466/941] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:19.981973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b25c6-eeff-48a2-98c4-06de81dbf4a8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:20.009378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a61964-c2d9-4179-871d-774478b5e2e7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:20.042578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:20.053724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfdf05-f9aa-48cd-854f-377b7b3f5a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:20.054438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfdf05-f9aa-48cd-854f-377b7b3f5a8d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:20.054721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfdf05-f9aa-48cd-854f-377b7b3f5a8d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:20.054993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfdf05-f9aa-48cd-854f-377b7b3f5a8d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:20.055706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfdf05-f9aa-48cd-854f-377b7b3f5a8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:20.056906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfdf05-f9aa-48cd-854f-377b7b3f5a8d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a7cfdf05-f9aa-48cd-854f-377b7b3f5a8d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:20.071229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:20.072283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:20.073170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 476/942] 10.222.0.77 () {56 vars in 1132 bytes} [Wed Aug 10 22:42:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:20.074676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfdf05-f9aa-48cd-854f-377b7b3f5a8d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:20.111030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b25c6-eeff-48a2-98c4-06de81dbf4a8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:20.140785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:20.146568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3d70c-67f6-484d-a3f1-f17880d2730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:20.147271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d70c-67f6-484d-a3f1-f17880d2730f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:20.147450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d70c-67f6-484d-a3f1-f17880d2730f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:20.147693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d70c-67f6-484d-a3f1-f17880d2730f None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:20.148320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3d70c-67f6-484d-a3f1-f17880d2730f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:20.148620 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3d70c-67f6-484d-a3f1-f17880d2730f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:20.149998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3d70c-67f6-484d-a3f1-f17880d2730f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:20.163863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 467/943] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Aug 10 22:42:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:20.163863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3d70c-67f6-484d-a3f1-f17880d2730f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:20.188642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfdf05-f9aa-48cd-854f-377b7b3f5a8d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:20.227910 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4982f-89d3-4c0b-ab5f-dffa07971bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:20.228592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4982f-89d3-4c0b-ab5f-dffa07971bbe None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:20.228883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4982f-89d3-4c0b-ab5f-dffa07971bbe None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:20.229137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4982f-89d3-4c0b-ab5f-dffa07971bbe None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:20.229991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4982f-89d3-4c0b-ab5f-dffa07971bbe None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:20.230354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4982f-89d3-4c0b-ab5f-dffa07971bbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:20.232595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4982f-89d3-4c0b-ab5f-dffa07971bbe None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:20.265322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 477/944] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:20.265322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4982f-89d3-4c0b-ab5f-dffa07971bbe None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:20.267095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3d70c-67f6-484d-a3f1-f17880d2730f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:20.282533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:20.313480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedc234-97e0-49a5-bbee-a2a5122d34a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:20.315105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc234-97e0-49a5-bbee-a2a5122d34a3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:20.315380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc234-97e0-49a5-bbee-a2a5122d34a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:20.315645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedc234-97e0-49a5-bbee-a2a5122d34a3 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:20.316840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedc234-97e0-49a5-bbee-a2a5122d34a3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:20.317135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedc234-97e0-49a5-bbee-a2a5122d34a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:20.319724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedc234-97e0-49a5-bbee-a2a5122d34a3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:20.327840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 468/945] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:20.333989 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedc234-97e0-49a5-bbee-a2a5122d34a3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:20.392584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4982f-89d3-4c0b-ab5f-dffa07971bbe None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:20.415467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:20.430378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de17e5-adfb-4048-a452-3d5e96950a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:20.431039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de17e5-adfb-4048-a452-3d5e96950a45 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:20.431257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de17e5-adfb-4048-a452-3d5e96950a45 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:20.431564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de17e5-adfb-4048-a452-3d5e96950a45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:20.432225 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de17e5-adfb-4048-a452-3d5e96950a45 None admin] RBAC: Adding query filter params (interface=public, service_id=3992ae4bbcfc466d9a10a6a748a59d93, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:20.432516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de17e5-adfb-4048-a452-3d5e96950a45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:20.434035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de17e5-adfb-4048-a452-3d5e96950a45 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:20.440015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 478/946] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Aug 10 22:42:20 2022] GET /identity/v3/endpoints?service_id=3992ae4bbcfc466d9a10a6a748a59d93&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:20.447474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de17e5-adfb-4048-a452-3d5e96950a45 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:20.458137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedc234-97e0-49a5-bbee-a2a5122d34a3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:20.500393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f4af-2e6a-4334-b389-e6036aaebc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:20.501548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f4af-2e6a-4334-b389-e6036aaebc40 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:20.501548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f4af-2e6a-4334-b389-e6036aaebc40 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:20.501755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f4af-2e6a-4334-b389-e6036aaebc40 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:20.502206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85f4af-2e6a-4334-b389-e6036aaebc40 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:20.502512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85f4af-2e6a-4334-b389-e6036aaebc40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:20.504517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85f4af-2e6a-4334-b389-e6036aaebc40 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:20.510834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 469/947] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:20.516719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f4af-2e6a-4334-b389-e6036aaebc40 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:20.571984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:20.583676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de17e5-adfb-4048-a452-3d5e96950a45 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:20.633740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478211da-d519-457c-83d0-10c8221cebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:20.634737 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478211da-d519-457c-83d0-10c8221cebcd None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:20.635160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478211da-d519-457c-83d0-10c8221cebcd None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:20.635867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478211da-d519-457c-83d0-10c8221cebcd None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:20.637083 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478211da-d519-457c-83d0-10c8221cebcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:20.638860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478211da-d519-457c-83d0-10c8221cebcd None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:20.647934 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 479/948] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Aug 10 22:42:20 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 22:42:20.661521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f4af-2e6a-4334-b389-e6036aaebc40 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:20.702521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fa80b-01e6-479d-bd3c-df56a4f1c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:20.703385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fa80b-01e6-479d-bd3c-df56a4f1c27e None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:20.703804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fa80b-01e6-479d-bd3c-df56a4f1c27e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:20.704233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fa80b-01e6-479d-bd3c-df56a4f1c27e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:20.705055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fa80b-01e6-479d-bd3c-df56a4f1c27e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:20.706756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fa80b-01e6-479d-bd3c-df56a4f1c27e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:20.818697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 470/949] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 22:42:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:42:21.501581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b43c8-3f3b-45a2-aed4-974fee8dba69 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:21.502613 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b43c8-3f3b-45a2-aed4-974fee8dba69 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:21.503088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b43c8-3f3b-45a2-aed4-974fee8dba69 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:21.504963 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 480/950] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:21.510343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8fabd-f30d-4bf7-a138-d783b5decc08 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:21.510853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8fabd-f30d-4bf7-a138-d783b5decc08 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:21.511333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8fabd-f30d-4bf7-a138-d783b5decc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:21.530796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-d0a8fabd-f30d-4bf7-a138-d783b5decc08 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:21.532309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d0a8fabd-f30d-4bf7-a138-d783b5decc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:21.609415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 471/951] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:21.632650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b43c8-3f3b-45a2-aed4-974fee8dba69 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:21.684511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:21.736802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b43c8-3f3b-45a2-aed4-974fee8dba69 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:21.774261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370785e2-f285-4e5e-8d82-72f6c7619cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:21.774845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370785e2-f285-4e5e-8d82-72f6c7619cf6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:21.775143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370785e2-f285-4e5e-8d82-72f6c7619cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:21.775459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370785e2-f285-4e5e-8d82-72f6c7619cf6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:21.787110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370785e2-f285-4e5e-8d82-72f6c7619cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-370785e2-f285-4e5e-8d82-72f6c7619cf6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:21.791964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:21.793023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:21.794351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 481/952] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Aug 10 22:42:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:21.799925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8fabd-f30d-4bf7-a138-d783b5decc08 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:21.825361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:21.903322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8fabd-f30d-4bf7-a138-d783b5decc08 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:21.937443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bda391-8c89-4497-8035-d9602dea4730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:21.938048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bda391-8c89-4497-8035-d9602dea4730 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:21.938318 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bda391-8c89-4497-8035-d9602dea4730 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:21.938582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bda391-8c89-4497-8035-d9602dea4730 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:21.939239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bda391-8c89-4497-8035-d9602dea4730 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:21.939593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bda391-8c89-4497-8035-d9602dea4730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:21.941573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bda391-8c89-4497-8035-d9602dea4730 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:21.950509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 472/953] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Aug 10 22:42:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:21.956282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370785e2-f285-4e5e-8d82-72f6c7619cf6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:22.069791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370785e2-f285-4e5e-8d82-72f6c7619cf6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:22.084055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:22.110214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b99b0b-0b5e-484a-9408-c495ff59482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:22.110839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99b0b-0b5e-484a-9408-c495ff59482a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:22.113848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99b0b-0b5e-484a-9408-c495ff59482a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:22.113848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b99b0b-0b5e-484a-9408-c495ff59482a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:22.122323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b99b0b-0b5e-484a-9408-c495ff59482a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:22.123762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b99b0b-0b5e-484a-9408-c495ff59482a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-36b99b0b-0b5e-484a-9408-c495ff59482a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:22.138105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:22.139320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:22.140426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:22.140426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:22.140426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:22.142298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 482/954] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:22.149019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bda391-8c89-4497-8035-d9602dea4730 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:22.243477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:22.261790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bda391-8c89-4497-8035-d9602dea4730 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:22.297470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23862974-b131-4104-98f2-e35ab1bfdd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:22.298073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23862974-b131-4104-98f2-e35ab1bfdd85 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:22.298348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23862974-b131-4104-98f2-e35ab1bfdd85 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:22.298612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23862974-b131-4104-98f2-e35ab1bfdd85 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:22.299249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23862974-b131-4104-98f2-e35ab1bfdd85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:22.299545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23862974-b131-4104-98f2-e35ab1bfdd85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:22.300908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23862974-b131-4104-98f2-e35ab1bfdd85 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:22.312890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 473/955] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:22.318589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b99b0b-0b5e-484a-9408-c495ff59482a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:22.431031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c11e-8b4b-4dc1-b4a1-11dd9d537ee1 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:22.431331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c11e-8b4b-4dc1-b4a1-11dd9d537ee1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:22.431511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c11e-8b4b-4dc1-b4a1-11dd9d537ee1 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:22.432950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 474/956] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:22.434660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b99b0b-0b5e-484a-9408-c495ff59482a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:22.438136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48429c-bdfe-4113-8513-148e34fb05f1 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:22.438466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48429c-bdfe-4113-8513-148e34fb05f1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:22.438730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48429c-bdfe-4113-8513-148e34fb05f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:22.458628 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-fa48429c-bdfe-4113-8513-148e34fb05f1 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:22.460214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fa48429c-bdfe-4113-8513-148e34fb05f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:22.475409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4c7e8-85ca-4d41-8dcb-8deb3020c7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:22.476420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4c7e8-85ca-4d41-8dcb-8deb3020c7f1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:22.476893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4c7e8-85ca-4d41-8dcb-8deb3020c7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:22.477392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4c7e8-85ca-4d41-8dcb-8deb3020c7f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:22.485735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4c7e8-85ca-4d41-8dcb-8deb3020c7f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:22.487474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4c7e8-85ca-4d41-8dcb-8deb3020c7f1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-32b4c7e8-85ca-4d41-8dcb-8deb3020c7f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:22.499176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:22.500121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:22.501047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:22.501047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:22.501047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:22.501047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:22.501047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:22.501047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:22.501047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:22.501047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:22.501047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 22:42:22.501047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:22.504157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 483/957] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Aug 10 22:42:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:22.514512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4c7e8-85ca-4d41-8dcb-8deb3020c7f1 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:22.543374 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:22.550420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 475/958] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:22.582315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48429c-bdfe-4113-8513-148e34fb05f1 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:22.631379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4c7e8-85ca-4d41-8dcb-8deb3020c7f1 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:22.667290 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba288d0-b944-4613-a7b9-b7189d7b81bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:22.667888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba288d0-b944-4613-a7b9-b7189d7b81bb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:22.668161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba288d0-b944-4613-a7b9-b7189d7b81bb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:22.668427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba288d0-b944-4613-a7b9-b7189d7b81bb None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:22.669151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba288d0-b944-4613-a7b9-b7189d7b81bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:22.669558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba288d0-b944-4613-a7b9-b7189d7b81bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:22.670986 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba288d0-b944-4613-a7b9-b7189d7b81bb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:22.681747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:22.690328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 484/959] 10.222.0.77 () {56 vars in 1149 bytes} [Wed Aug 10 22:42:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:22.698803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba288d0-b944-4613-a7b9-b7189d7b81bb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:22.708514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48429c-bdfe-4113-8513-148e34fb05f1 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:22.749311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcb3ef-ba1d-4546-878b-287c489e2e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:22.750303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcb3ef-ba1d-4546-878b-287c489e2e23 None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:22.750579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcb3ef-ba1d-4546-878b-287c489e2e23 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:22.750843 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcb3ef-ba1d-4546-878b-287c489e2e23 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:22.751803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcb3ef-ba1d-4546-878b-287c489e2e23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:22.753972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcb3ef-ba1d-4546-878b-287c489e2e23 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:22.789609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:22.810788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba288d0-b944-4613-a7b9-b7189d7b81bb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:22.844769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680892b-894c-48de-b844-62f631d4a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:22.845416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680892b-894c-48de-b844-62f631d4a294 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:22.845697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680892b-894c-48de-b844-62f631d4a294 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:22.845969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680892b-894c-48de-b844-62f631d4a294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:22.873850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.sql.core [None req-fcbcb3ef-ba1d-4546-878b-287c489e2e23 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 22:42:22.873850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 22:42:22.873850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [parameters: {'user_id': '0bedac77d3314d798b4c24ee6cccf0f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 22:42:22.873850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93407) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-fcbcb3ef-ba1d-4546-878b-287c489e2e23 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application conn.query(q) Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application result.read() Aug 10 22:42:22.880292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 22:42:22.886281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application next(self.gen) Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application yield resource Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application next(self.gen) Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise self.value Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application session.commit() Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 22:42:22.887254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self.session.flush() Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application compat.raise_( Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 22:42:22.888192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 22:42:22.889112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application conn.query(q) Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application result.read() Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 22:42:22.891490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [parameters: {'user_id': '0bedac77d3314d798b4c24ee6cccf0f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:22.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 10 22:42:22.893641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 10 22:42:22.895334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 10 22:42:22.895334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 10 22:42:22.895334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 22:42:22.895334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 22:42:22.895334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 22:42:22.895334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:22.895334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 476/960] 10.222.0.77 () {60 vars in 1131 bytes} [Wed Aug 10 22:42:22 2022] POST /identity/v3/users => generated 160 bytes in 300 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:22.895334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c2373-923e-4d46-8f0a-fe31b665a604 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:22.895334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c2373-923e-4d46-8f0a-fe31b665a604 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:22.895334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c2373-923e-4d46-8f0a-fe31b665a604 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:22.896033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 477/961] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:22.896033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c2373-923e-4d46-8f0a-fe31b665a604 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:22.931135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680892b-894c-48de-b844-62f631d4a294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:22.932754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680892b-894c-48de-b844-62f631d4a294 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.010314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c2373-923e-4d46-8f0a-fe31b665a604 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.017750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:23.040656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 485/962] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:22 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:42:23.042051 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50063ce3-c779-4759-bbc8-5acddcf80b80 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.042336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50063ce3-c779-4759-bbc8-5acddcf80b80 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.042609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50063ce3-c779-4759-bbc8-5acddcf80b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.044229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3cb82-1e8c-4ba8-a19c-88de344ea2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.044850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3cb82-1e8c-4ba8-a19c-88de344ea2b7 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.045119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3cb82-1e8c-4ba8-a19c-88de344ea2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.045410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3cb82-1e8c-4ba8-a19c-88de344ea2b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.047472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:23.053436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3cb82-1e8c-4ba8-a19c-88de344ea2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.054982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3cb82-1e8c-4ba8-a19c-88de344ea2b7 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.060478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-50063ce3-c779-4759-bbc8-5acddcf80b80 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:23.063521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-50063ce3-c779-4759-bbc8-5acddcf80b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-74a3cb82-1e8c-4ba8-a19c-88de344ea2b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:23.066485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:23.067419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:23.068465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 478/963] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:42:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:23.069057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66546696-695f-480e-8b7e-2d721aa7f55d None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.069057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66546696-695f-480e-8b7e-2d721aa7f55d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.069343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66546696-695f-480e-8b7e-2d721aa7f55d None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.070556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 479/964] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:23.071237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66546696-695f-480e-8b7e-2d721aa7f55d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:23.134163 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 486/965] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:23.134997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50063ce3-c779-4759-bbc8-5acddcf80b80 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:23.187207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66546696-695f-480e-8b7e-2d721aa7f55d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.223082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924a6ea-f77f-4c02-95d4-fc5f367862df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.223965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924a6ea-f77f-4c02-95d4-fc5f367862df None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.224232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924a6ea-f77f-4c02-95d4-fc5f367862df None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.224493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924a6ea-f77f-4c02-95d4-fc5f367862df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.232134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50063ce3-c779-4759-bbc8-5acddcf80b80 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.234756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924a6ea-f77f-4c02-95d4-fc5f367862df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.236177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924a6ea-f77f-4c02-95d4-fc5f367862df None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.241169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-6924a6ea-f77f-4c02-95d4-fc5f367862df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:23.250451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:23.259583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:23.260738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:23.260738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:23.260738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:23.260738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 480/966] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:23.260738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b237a0-9e58-425c-a0cf-08659d773e26 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.260738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b237a0-9e58-425c-a0cf-08659d773e26 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.260738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b237a0-9e58-425c-a0cf-08659d773e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.268104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d0fe-3ac9-46dc-86cb-2178ab51f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.268712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d0fe-3ac9-46dc-86cb-2178ab51f5e0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.269612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d0fe-3ac9-46dc-86cb-2178ab51f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.270313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15d0fe-3ac9-46dc-86cb-2178ab51f5e0 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.271025 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15d0fe-3ac9-46dc-86cb-2178ab51f5e0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:23.271489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15d0fe-3ac9-46dc-86cb-2178ab51f5e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.272970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15d0fe-3ac9-46dc-86cb-2178ab51f5e0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.275287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-69b237a0-9e58-425c-a0cf-08659d773e26 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:23.276801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-69b237a0-9e58-425c-a0cf-08659d773e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:23.315604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 487/967] 10.222.0.77 () {56 vars in 1101 bytes} [Wed Aug 10 22:42:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:23.316961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d0fe-3ac9-46dc-86cb-2178ab51f5e0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:23.326033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:23.362291 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 481/968] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:23.363515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b237a0-9e58-425c-a0cf-08659d773e26 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:23.462820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15d0fe-3ac9-46dc-86cb-2178ab51f5e0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.484468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b237a0-9e58-425c-a0cf-08659d773e26 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.513126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a3598-44f5-4089-a4d3-cf5bbe332a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.514134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a3598-44f5-4089-a4d3-cf5bbe332a40 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.514413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a3598-44f5-4089-a4d3-cf5bbe332a40 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.514809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a3598-44f5-4089-a4d3-cf5bbe332a40 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.515562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a3598-44f5-4089-a4d3-cf5bbe332a40 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.517758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a3598-44f5-4089-a4d3-cf5bbe332a40 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.520891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dffcdb-c5e5-40d3-a23f-25d884b73ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.521830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dffcdb-c5e5-40d3-a23f-25d884b73ded None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.521830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dffcdb-c5e5-40d3-a23f-25d884b73ded None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.522079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dffcdb-c5e5-40d3-a23f-25d884b73ded None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.522717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dffcdb-c5e5-40d3-a23f-25d884b73ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:23.523014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dffcdb-c5e5-40d3-a23f-25d884b73ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.524377 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dffcdb-c5e5-40d3-a23f-25d884b73ded None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-218a3598-44f5-4089-a4d3-cf5bbe332a40 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:23.527316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:23.528321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:23.529174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 488/969] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:23.530446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a3598-44f5-4089-a4d3-cf5bbe332a40 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:23.541408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 482/970] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:23.541408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dffcdb-c5e5-40d3-a23f-25d884b73ded None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:23.570643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:23.584803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:23.651546 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a3598-44f5-4089-a4d3-cf5bbe332a40 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.651837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dffcdb-c5e5-40d3-a23f-25d884b73ded None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.686087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9122583-a455-49fe-868f-4dee8a5f596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.686690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122583-a455-49fe-868f-4dee8a5f596e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.687024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122583-a455-49fe-868f-4dee8a5f596e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.687225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122583-a455-49fe-868f-4dee8a5f596e None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.687845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122583-a455-49fe-868f-4dee8a5f596e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:23.688143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122583-a455-49fe-868f-4dee8a5f596e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.689519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122583-a455-49fe-868f-4dee8a5f596e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.689810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77d54d-89bd-45cd-a41c-2525a6c4094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.690431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77d54d-89bd-45cd-a41c-2525a6c4094f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.690760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77d54d-89bd-45cd-a41c-2525a6c4094f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.691528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77d54d-89bd-45cd-a41c-2525a6c4094f None admin] PATH_INFO: `/v3/services/compute` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.692108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77d54d-89bd-45cd-a41c-2525a6c4094f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.693473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77d54d-89bd-45cd-a41c-2525a6c4094f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.694945 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 483/971] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Aug 10 22:42:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:23.695725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9122583-a455-49fe-868f-4dee8a5f596e None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-4f77d54d-89bd-45cd-a41c-2525a6c4094f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:23.702395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:23.703566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:23.704395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 489/972] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:23.705217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77d54d-89bd-45cd-a41c-2525a6c4094f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:23.795002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:23.798028 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9122583-a455-49fe-868f-4dee8a5f596e None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.799808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:23.806677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77d54d-89bd-45cd-a41c-2525a6c4094f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.832980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf65466-67cc-40ee-a6b4-edb1e7e4f349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.833634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65466-67cc-40ee-a6b4-edb1e7e4f349 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.833912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65466-67cc-40ee-a6b4-edb1e7e4f349 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.834174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65466-67cc-40ee-a6b4-edb1e7e4f349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.840647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf65466-67cc-40ee-a6b4-edb1e7e4f349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.841132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fa08b-9403-4ba8-9d0c-de3d6a55d0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.841782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fa08b-9403-4ba8-9d0c-de3d6a55d0c8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.842059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fa08b-9403-4ba8-9d0c-de3d6a55d0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.842157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf65466-67cc-40ee-a6b4-edb1e7e4f349 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.842330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fa08b-9403-4ba8-9d0c-de3d6a55d0c8 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.842953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fa08b-9403-4ba8-9d0c-de3d6a55d0c8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:23.843251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fa08b-9403-4ba8-9d0c-de3d6a55d0c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.844615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fa08b-9403-4ba8-9d0c-de3d6a55d0c8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.850189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 490/973] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Aug 10 22:42:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:23.850508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fa08b-9403-4ba8-9d0c-de3d6a55d0c8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-aaf65466-67cc-40ee-a6b4-edb1e7e4f349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:23.853315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:23.854183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:23.855070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:23.855070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:23.855070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:23.855070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:23.855070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:23.855070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:23.855070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:23.855070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:23.855070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 484/974] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:23.855551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf65466-67cc-40ee-a6b4-edb1e7e4f349 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:23.953168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fa08b-9403-4ba8-9d0c-de3d6a55d0c8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.959383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf65466-67cc-40ee-a6b4-edb1e7e4f349 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:23.990914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e52d5-7736-44b1-a041-5e77745da7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.991512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e52d5-7736-44b1-a041-5e77745da7aa None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.991787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e52d5-7736-44b1-a041-5e77745da7aa None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.992058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e52d5-7736-44b1-a041-5e77745da7aa None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.992683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e52d5-7736-44b1-a041-5e77745da7aa None admin] RBAC: Adding query filter params (name=compute) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:23.992983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e52d5-7736-44b1-a041-5e77745da7aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.994381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e52d5-7736-44b1-a041-5e77745da7aa None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.995363 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fecc8e-972b-421b-96f0-e47335deee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:23.995960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fecc8e-972b-421b-96f0-e47335deee23 None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:23.996229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fecc8e-972b-421b-96f0-e47335deee23 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:23.996494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fecc8e-972b-421b-96f0-e47335deee23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:23.997133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fecc8e-972b-421b-96f0-e47335deee23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:23.998483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fecc8e-972b-421b-96f0-e47335deee23 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:23.999099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 491/975] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:23.999874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e52d5-7736-44b1-a041-5e77745da7aa None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:24.026529 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:24.057218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 485/976] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 22:42:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:42:24.058015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fecc8e-972b-421b-96f0-e47335deee23 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:24.095329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:24.107443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e52d5-7736-44b1-a041-5e77745da7aa None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:24.151285 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6db4dc-8205-4ee3-a78a-288203ed0ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:24.151962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db4dc-8205-4ee3-a78a-288203ed0ab7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:24.152237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db4dc-8205-4ee3-a78a-288203ed0ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:24.152440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db4dc-8205-4ee3-a78a-288203ed0ab7 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:24.153139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6db4dc-8205-4ee3-a78a-288203ed0ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:24.153475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6db4dc-8205-4ee3-a78a-288203ed0ab7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:24.154969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6db4dc-8205-4ee3-a78a-288203ed0ab7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:24.173456 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 492/977] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:24.176263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6db4dc-8205-4ee3-a78a-288203ed0ab7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:24.199608 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fecc8e-972b-421b-96f0-e47335deee23 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:24.243539 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4b70-443c-433b-a2ae-46d583dc009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:24.244154 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4b70-443c-433b-a2ae-46d583dc009e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:24.244449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4b70-443c-433b-a2ae-46d583dc009e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:24.244698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4b70-443c-433b-a2ae-46d583dc009e None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:24.245350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4b70-443c-433b-a2ae-46d583dc009e None admin] RBAC: Adding query filter params (type=compute) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:24.245653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4b70-443c-433b-a2ae-46d583dc009e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:24.246997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4b70-443c-433b-a2ae-46d583dc009e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:24.252025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 486/978] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:24.272518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:24.299474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6db4dc-8205-4ee3-a78a-288203ed0ab7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:24.340599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096cd79-2fae-4d12-845b-bcd05bc659f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:24.341123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096cd79-2fae-4d12-845b-bcd05bc659f2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:24.341433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096cd79-2fae-4d12-845b-bcd05bc659f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:24.341705 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096cd79-2fae-4d12-845b-bcd05bc659f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:24.342444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096cd79-2fae-4d12-845b-bcd05bc659f2 None admin] RBAC: Adding query filter params (role.id=0de4cd838d5c4fc1accf3463cffd2283, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=3500bd875ccf4a3c8302d0f6ce11c12b) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:24.342753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096cd79-2fae-4d12-845b-bcd05bc659f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:24.344202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096cd79-2fae-4d12-845b-bcd05bc659f2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:24.352595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 493/979] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:24 2022] GET /identity/v3/role_assignments?user.id=3500bd875ccf4a3c8302d0f6ce11c12b&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=0de4cd838d5c4fc1accf3463cffd2283 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:26.113499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76524cd3-42b8-4a12-8f92-c114c29d9094 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.114027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76524cd3-42b8-4a12-8f92-c114c29d9094 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.114027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76524cd3-42b8-4a12-8f92-c114c29d9094 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.117332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 487/980] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:26.120544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f06e6-2cc7-4c2a-87a5-955c7f72c495 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.120953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f06e6-2cc7-4c2a-87a5-955c7f72c495 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.121363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f06e6-2cc7-4c2a-87a5-955c7f72c495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.139864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-605f06e6-2cc7-4c2a-87a5-955c7f72c495 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:26.141039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-605f06e6-2cc7-4c2a-87a5-955c7f72c495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:26.209172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 494/981] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:26.232072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76524cd3-42b8-4a12-8f92-c114c29d9094 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:26.303491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2340-71b3-4393-83ac-fa456b00e8f5 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.303778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2340-71b3-4393-83ac-fa456b00e8f5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.304027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf2340-71b3-4393-83ac-fa456b00e8f5 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.305378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 495/982] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:26.310421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b3abd-73ca-4465-89e1-e10f0f23d4a4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.310702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b3abd-73ca-4465-89e1-e10f0f23d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.311449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b3abd-73ca-4465-89e1-e10f0f23d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.315067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:26.330924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-de9b3abd-73ca-4465-89e1-e10f0f23d4a4 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:26.332161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-de9b3abd-73ca-4465-89e1-e10f0f23d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:26.336897 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76524cd3-42b8-4a12-8f92-c114c29d9094 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:26.375330 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9200050-7497-4b15-8455-d0c81e6b69ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:26.375919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9200050-7497-4b15-8455-d0c81e6b69ac None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.376192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9200050-7497-4b15-8455-d0c81e6b69ac None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.376452 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9200050-7497-4b15-8455-d0c81e6b69ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.377022 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9200050-7497-4b15-8455-d0c81e6b69ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:26.378460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9200050-7497-4b15-8455-d0c81e6b69ac None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-f9200050-7497-4b15-8455-d0c81e6b69ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:26.387623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:26.388624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:26.389491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 488/983] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:26.394547 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9200050-7497-4b15-8455-d0c81e6b69ac None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:26.413330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 496/984] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:26.416669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8634b-7581-42a1-9790-d423192a173a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.416950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8634b-7581-42a1-9790-d423192a173a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.417218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8634b-7581-42a1-9790-d423192a173a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.418532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 497/985] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:26.423310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f3054-13c7-4830-afe9-d8c5fd3f3683 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.423586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f3054-13c7-4830-afe9-d8c5fd3f3683 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.423856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f3054-13c7-4830-afe9-d8c5fd3f3683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.430541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:26.442630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-466f3054-13c7-4830-afe9-d8c5fd3f3683 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:26.443822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-466f3054-13c7-4830-afe9-d8c5fd3f3683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:26.501340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9200050-7497-4b15-8455-d0c81e6b69ac None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:26.510952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 498/986] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:26.511827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f3054-13c7-4830-afe9-d8c5fd3f3683 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:26.542549 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153bab5-a0a7-436f-8ff6-6b17baba9d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:26.543158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153bab5-a0a7-436f-8ff6-6b17baba9d0a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.543435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153bab5-a0a7-436f-8ff6-6b17baba9d0a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.543714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153bab5-a0a7-436f-8ff6-6b17baba9d0a None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.544387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153bab5-a0a7-436f-8ff6-6b17baba9d0a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:26.544727 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153bab5-a0a7-436f-8ff6-6b17baba9d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:26.546193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153bab5-a0a7-436f-8ff6-6b17baba9d0a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:26.555609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 489/987] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Aug 10 22:42:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:26.556538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153bab5-a0a7-436f-8ff6-6b17baba9d0a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:26.567600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:26.623843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f3054-13c7-4830-afe9-d8c5fd3f3683 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:26.653129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:26.655555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153bab5-a0a7-436f-8ff6-6b17baba9d0a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:26.657870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35482b18-3c7a-4775-9806-4eb7de623453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:26.658484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35482b18-3c7a-4775-9806-4eb7de623453 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.658741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35482b18-3c7a-4775-9806-4eb7de623453 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.659005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35482b18-3c7a-4775-9806-4eb7de623453 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.660271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35482b18-3c7a-4775-9806-4eb7de623453 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:26.661653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35482b18-3c7a-4775-9806-4eb7de623453 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:26.689153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70504108-a4bc-4722-9188-43f664d6d440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:26.689833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70504108-a4bc-4722-9188-43f664d6d440 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.690127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70504108-a4bc-4722-9188-43f664d6d440 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.690377 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70504108-a4bc-4722-9188-43f664d6d440 None admin] PATH_INFO: `/v3/services/image` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.690975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70504108-a4bc-4722-9188-43f664d6d440 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:26.692299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70504108-a4bc-4722-9188-43f664d6d440 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-70504108-a4bc-4722-9188-43f664d6d440 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:26.700764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:26.701912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:26.702775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 490/988] 10.222.0.77 () {56 vars in 1105 bytes} [Wed Aug 10 22:42:26 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:26.703545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70504108-a4bc-4722-9188-43f664d6d440 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:26.741353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 499/989] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:42:26 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:42:26.741353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35482b18-3c7a-4775-9806-4eb7de623453 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:26.790808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:26.824395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70504108-a4bc-4722-9188-43f664d6d440 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:26.865439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35482b18-3c7a-4775-9806-4eb7de623453 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:26.871031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a487353-73a3-44d4-b1fa-43c11a30edd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:26.871924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a487353-73a3-44d4-b1fa-43c11a30edd4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.872352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a487353-73a3-44d4-b1fa-43c11a30edd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.872871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a487353-73a3-44d4-b1fa-43c11a30edd4 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.873932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a487353-73a3-44d4-b1fa-43c11a30edd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:26.874394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a487353-73a3-44d4-b1fa-43c11a30edd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:26.876031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a487353-73a3-44d4-b1fa-43c11a30edd4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:26.887379 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 491/990] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Aug 10 22:42:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:26.888334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a487353-73a3-44d4-b1fa-43c11a30edd4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:26.903260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f031f-78f0-4a1b-b7c3-be76b1e8b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:26.903756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f031f-78f0-4a1b-b7c3-be76b1e8b8aa None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:26.904027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f031f-78f0-4a1b-b7c3-be76b1e8b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:26.904300 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f031f-78f0-4a1b-b7c3-be76b1e8b8aa None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:26.904983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f031f-78f0-4a1b-b7c3-be76b1e8b8aa None admin] RBAC: Adding query filter params (name=image) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:26.905283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f031f-78f0-4a1b-b7c3-be76b1e8b8aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:26.906671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f031f-78f0-4a1b-b7c3-be76b1e8b8aa None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:26.911658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 500/991] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:26.917982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f031f-78f0-4a1b-b7c3-be76b1e8b8aa None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:26.981947 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:27.024553 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a487353-73a3-44d4-b1fa-43c11a30edd4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:27.032042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f031f-78f0-4a1b-b7c3-be76b1e8b8aa None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:27.056227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:27.061897 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c4ed5-07c4-430f-9ea9-d87a1ca2687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:27.062512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c4ed5-07c4-430f-9ea9-d87a1ca2687e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:27.062782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c4ed5-07c4-430f-9ea9-d87a1ca2687e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:27.063049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c4ed5-07c4-430f-9ea9-d87a1ca2687e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:27.063745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c4ed5-07c4-430f-9ea9-d87a1ca2687e None admin] RBAC: Adding query filter params (interface=admin, service_id=3992ae4bbcfc466d9a10a6a748a59d93, region_id=RegionOne) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:27.064050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c4ed5-07c4-430f-9ea9-d87a1ca2687e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:27.065484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c4ed5-07c4-430f-9ea9-d87a1ca2687e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:27.067327 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31ae31-bbc0-47ee-9c34-ede9b1211c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:27.074594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31ae31-bbc0-47ee-9c34-ede9b1211c2f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:27.074594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31ae31-bbc0-47ee-9c34-ede9b1211c2f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:27.074594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31ae31-bbc0-47ee-9c34-ede9b1211c2f None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:27.074594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31ae31-bbc0-47ee-9c34-ede9b1211c2f None admin] RBAC: Adding query filter params (type=image) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:27.074594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31ae31-bbc0-47ee-9c34-ede9b1211c2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:27.074594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31ae31-bbc0-47ee-9c34-ede9b1211c2f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:27.075250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 492/992] 10.222.0.77 () {56 vars in 1249 bytes} [Wed Aug 10 22:42:26 2022] GET /identity/v3/endpoints?service_id=3992ae4bbcfc466d9a10a6a748a59d93&interface=admin®ion_id=RegionOne => generated 193 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:27.077210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c4ed5-07c4-430f-9ea9-d87a1ca2687e None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:27.079820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 501/993] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:27.188712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c4ed5-07c4-430f-9ea9-d87a1ca2687e None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:27.228282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012daa5d-c103-4a12-a01d-2b1cf70b65f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:27.228893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012daa5d-c103-4a12-a01d-2b1cf70b65f5 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:27.229366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012daa5d-c103-4a12-a01d-2b1cf70b65f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:27.229642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012daa5d-c103-4a12-a01d-2b1cf70b65f5 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:27.230234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012daa5d-c103-4a12-a01d-2b1cf70b65f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:27.231603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012daa5d-c103-4a12-a01d-2b1cf70b65f5 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:27.238945 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 493/994] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Aug 10 22:42:27 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 22:42:28.774006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713aa70b-1c3b-4e30-bb45-6835fb4da033 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:28.774574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713aa70b-1c3b-4e30-bb45-6835fb4da033 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:28.774574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713aa70b-1c3b-4e30-bb45-6835fb4da033 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:28.776017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 502/995] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:28.781153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f85e1-cccf-4d3a-94c5-9b035a359b7a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:28.781676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f85e1-cccf-4d3a-94c5-9b035a359b7a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:28.781811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f85e1-cccf-4d3a-94c5-9b035a359b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:28.800656 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-5e7f85e1-cccf-4d3a-94c5-9b035a359b7a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:28.801858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5e7f85e1-cccf-4d3a-94c5-9b035a359b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:28.863013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:28.874065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 494/996] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:28.896555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713aa70b-1c3b-4e30-bb45-6835fb4da033 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:29.005130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713aa70b-1c3b-4e30-bb45-6835fb4da033 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:29.022212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:29.040683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46094dce-2bf5-4f2a-9b48-dc3010702811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:29.041324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46094dce-2bf5-4f2a-9b48-dc3010702811 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.041597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46094dce-2bf5-4f2a-9b48-dc3010702811 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.041864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46094dce-2bf5-4f2a-9b48-dc3010702811 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.042432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46094dce-2bf5-4f2a-9b48-dc3010702811 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:29.043774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46094dce-2bf5-4f2a-9b48-dc3010702811 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-46094dce-2bf5-4f2a-9b48-dc3010702811 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:29.052336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:29.053574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 22:42:29.054437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:29.057611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 503/997] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:29.059354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f85e1-cccf-4d3a-94c5-9b035a359b7a None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:29.109438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88cdaa-475d-4581-9f2b-d37ef18553f6 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.109785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88cdaa-475d-4581-9f2b-d37ef18553f6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.109978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88cdaa-475d-4581-9f2b-d37ef18553f6 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.111557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 504/998] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:29.117541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2282201-407d-441e-a52d-eeff681dc846 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.117774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2282201-407d-441e-a52d-eeff681dc846 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.118175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2282201-407d-441e-a52d-eeff681dc846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.141653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e2282201-407d-441e-a52d-eeff681dc846 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:29.143226 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e2282201-407d-441e-a52d-eeff681dc846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:29.164743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f85e1-cccf-4d3a-94c5-9b035a359b7a None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:29.202711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38485-3628-4da0-b761-388219804b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:29.203320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38485-3628-4da0-b761-388219804b03 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.203594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38485-3628-4da0-b761-388219804b03 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.203861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38485-3628-4da0-b761-388219804b03 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.204479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38485-3628-4da0-b761-388219804b03 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:29.204781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38485-3628-4da0-b761-388219804b03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:29.206719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38485-3628-4da0-b761-388219804b03 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:29.211709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 495/999] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:29.217269 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38485-3628-4da0-b761-388219804b03 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:29.228004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 505/1000] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:29.249999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2282201-407d-441e-a52d-eeff681dc846 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:29.274844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:29.317333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38485-3628-4da0-b761-388219804b03 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:29.347657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2282201-407d-441e-a52d-eeff681dc846 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:29.351055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f63bd-8c3e-4596-b978-1378293cffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:29.351658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f63bd-8c3e-4596-b978-1378293cffac None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.351932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f63bd-8c3e-4596-b978-1378293cffac None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.352198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f63bd-8c3e-4596-b978-1378293cffac None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.352851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f63bd-8c3e-4596-b978-1378293cffac None admin] RBAC: Adding query filter params (type=compute) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:29.353149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f63bd-8c3e-4596-b978-1378293cffac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:29.354570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f63bd-8c3e-4596-b978-1378293cffac None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:29.358487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:29.364353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 496/1001] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:29.364353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a74b0-c1c4-40ca-91c1-aa0de20d06a8 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.364353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a74b0-c1c4-40ca-91c1-aa0de20d06a8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.364353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a74b0-c1c4-40ca-91c1-aa0de20d06a8 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.364353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 497/1002] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:29.369635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a74b0-c1c4-40ca-91c1-aa0de20d06a8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:29.388281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3d17b-758e-48f4-930e-d95c672bb4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:29.389261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3d17b-758e-48f4-930e-d95c672bb4c9 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.389567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3d17b-758e-48f4-930e-d95c672bb4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.389839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3d17b-758e-48f4-930e-d95c672bb4c9 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.390483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3d17b-758e-48f4-930e-d95c672bb4c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:29.392714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3d17b-758e-48f4-930e-d95c672bb4c9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:29.467387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a74b0-c1c4-40ca-91c1-aa0de20d06a8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:29.483978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:29.500290 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0543f2-5e41-4f4b-8710-22f5e8f2c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:29.500931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0543f2-5e41-4f4b-8710-22f5e8f2c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.501149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0543f2-5e41-4f4b-8710-22f5e8f2c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.501446 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0543f2-5e41-4f4b-8710-22f5e8f2c9d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.502132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0543f2-5e41-4f4b-8710-22f5e8f2c9d4 None admin] RBAC: Adding query filter params (interface=public, service_id=26c78edbb5b644838723b7dbb7a6b55c, region_id=RegionOne) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:29.502429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0543f2-5e41-4f4b-8710-22f5e8f2c9d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:29.504456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0543f2-5e41-4f4b-8710-22f5e8f2c9d4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:29.509263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 506/1003] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:42:29 2022] POST /identity/v3/services => generated 242 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:42:29.512733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad50942-e7b5-49d3-9aa4-f23769abd496 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.512733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad50942-e7b5-49d3-9aa4-f23769abd496 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.512733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad50942-e7b5-49d3-9aa4-f23769abd496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.513604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 498/1004] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Aug 10 22:42:29 2022] GET /identity/v3/endpoints?service_id=26c78edbb5b644838723b7dbb7a6b55c&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:29.522658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0543f2-5e41-4f4b-8710-22f5e8f2c9d4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:29.534191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fad50942-e7b5-49d3-9aa4-f23769abd496 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:29.535535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fad50942-e7b5-49d3-9aa4-f23769abd496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:29.634236 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 507/1005] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:29 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:29.649050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0543f2-5e41-4f4b-8710-22f5e8f2c9d4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:29.657713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad50942-e7b5-49d3-9aa4-f23769abd496 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:29.694244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dae32d-b7c7-40b7-9a86-4cf182973ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:29.694862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dae32d-b7c7-40b7-9a86-4cf182973ddd None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.695139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dae32d-b7c7-40b7-9a86-4cf182973ddd None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.695430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dae32d-b7c7-40b7-9a86-4cf182973ddd None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.696011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dae32d-b7c7-40b7-9a86-4cf182973ddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:29.697509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dae32d-b7c7-40b7-9a86-4cf182973ddd None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:29.704795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 499/1006] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Aug 10 22:42:29 2022] GET /identity/v3/services => generated 1957 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 22:42:29.772462 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:29.779802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad50942-e7b5-49d3-9aa4-f23769abd496 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:29.822916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea1f24-436d-4815-aede-81ac81fa1594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:29.823558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea1f24-436d-4815-aede-81ac81fa1594 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.823832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea1f24-436d-4815-aede-81ac81fa1594 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.824101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea1f24-436d-4815-aede-81ac81fa1594 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.824693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea1f24-436d-4815-aede-81ac81fa1594 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:29.826116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea1f24-436d-4815-aede-81ac81fa1594 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-71ea1f24-436d-4815-aede-81ac81fa1594 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:29.835699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:29.836786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:29.837678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 508/1007] 10.222.0.77 () {56 vars in 1126 bytes} [Wed Aug 10 22:42:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:29.846653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dae32d-b7c7-40b7-9a86-4cf182973ddd None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:29.901313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:29.955119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dae32d-b7c7-40b7-9a86-4cf182973ddd None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:29.990148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177bd91-daeb-406a-b9dd-f453c4deab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:29.990754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177bd91-daeb-406a-b9dd-f453c4deab7f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:29.991026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177bd91-daeb-406a-b9dd-f453c4deab7f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:29.991292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177bd91-daeb-406a-b9dd-f453c4deab7f None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:29.991913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177bd91-daeb-406a-b9dd-f453c4deab7f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:29.992208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177bd91-daeb-406a-b9dd-f453c4deab7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:29.993581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177bd91-daeb-406a-b9dd-f453c4deab7f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:29.999850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 500/1008] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Aug 10 22:42:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:30.005772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea1f24-436d-4815-aede-81ac81fa1594 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:30.108577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea1f24-436d-4815-aede-81ac81fa1594 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:30.143126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d43196-84d1-4bf9-baa5-3ce2f85f5caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:30.143767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43196-84d1-4bf9-baa5-3ce2f85f5caf None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:30.144037 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43196-84d1-4bf9-baa5-3ce2f85f5caf None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:30.144300 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d43196-84d1-4bf9-baa5-3ce2f85f5caf None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:30.144923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d43196-84d1-4bf9-baa5-3ce2f85f5caf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:30.145216 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d43196-84d1-4bf9-baa5-3ce2f85f5caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:30.146614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d43196-84d1-4bf9-baa5-3ce2f85f5caf None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:30.156577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 509/1009] 10.222.0.77 () {56 vars in 1122 bytes} [Wed Aug 10 22:42:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:30.157630 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177bd91-daeb-406a-b9dd-f453c4deab7f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:30.261608 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177bd91-daeb-406a-b9dd-f453c4deab7f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:30.273708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:30.298227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d8874-1f65-441d-aa1d-1e6052de7ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:30.298824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d8874-1f65-441d-aa1d-1e6052de7ffd None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:30.299098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d8874-1f65-441d-aa1d-1e6052de7ffd None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:30.299366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d8874-1f65-441d-aa1d-1e6052de7ffd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:30.300069 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d8874-1f65-441d-aa1d-1e6052de7ffd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:30.301555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d8874-1f65-441d-aa1d-1e6052de7ffd None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:30.447529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 501/1010] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 22:42:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:42:31.547459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ecd02-1b6f-432d-8101-40f0942fa168 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:31.547459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ecd02-1b6f-432d-8101-40f0942fa168 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:31.547459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ecd02-1b6f-432d-8101-40f0942fa168 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:31.547459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 510/1011] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:31.553331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15651d12-d9f2-4164-9ad5-d44084e53133 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:31.553763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15651d12-d9f2-4164-9ad5-d44084e53133 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:31.553864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15651d12-d9f2-4164-9ad5-d44084e53133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:31.572375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-15651d12-d9f2-4164-9ad5-d44084e53133 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:31.573635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-15651d12-d9f2-4164-9ad5-d44084e53133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:31.653435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 502/1012] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:31 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:31.672315 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ecd02-1b6f-432d-8101-40f0942fa168 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:31.698788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:31.748773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d6941-6150-4105-9f86-be807c5a153c None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:31.749146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d6941-6150-4105-9f86-be807c5a153c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:31.749469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d6941-6150-4105-9f86-be807c5a153c None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:31.751198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 503/1013] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:31.757305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf0060-e556-41bf-b758-c1ca9a4495eb None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:31.757625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf0060-e556-41bf-b758-c1ca9a4495eb None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:31.757904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf0060-e556-41bf-b758-c1ca9a4495eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:31.778266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-cfaf0060-e556-41bf-b758-c1ca9a4495eb None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:31.779469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-cfaf0060-e556-41bf-b758-c1ca9a4495eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:31.792218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ecd02-1b6f-432d-8101-40f0942fa168 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:31.830201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddddaa-b560-4eb2-9f8a-75f687ceca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:31.831486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddddaa-b560-4eb2-9f8a-75f687ceca95 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:31.831596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddddaa-b560-4eb2-9f8a-75f687ceca95 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:31.831793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddddaa-b560-4eb2-9f8a-75f687ceca95 None admin] PATH_INFO: `/v3/services/image` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:31.832371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddddaa-b560-4eb2-9f8a-75f687ceca95 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:31.833759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddddaa-b560-4eb2-9f8a-75f687ceca95 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a9ddddaa-b560-4eb2-9f8a-75f687ceca95 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:31.843672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:31.845654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:31.846534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 511/1014] 10.222.0.77 () {56 vars in 1105 bytes} [Wed Aug 10 22:42:31 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:31.851747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddddaa-b560-4eb2-9f8a-75f687ceca95 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:31.861827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 504/1015] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:31 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:31.880550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf0060-e556-41bf-b758-c1ca9a4495eb None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:31.909195 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:31.948269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:31.961528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddddaa-b560-4eb2-9f8a-75f687ceca95 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:31.991758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf0060-e556-41bf-b758-c1ca9a4495eb None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:31.997738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682b136-ed23-4c32-9087-6c329f9f678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:31.998344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682b136-ed23-4c32-9087-6c329f9f678b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:31.998617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682b136-ed23-4c32-9087-6c329f9f678b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.000461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682b136-ed23-4c32-9087-6c329f9f678b None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.000461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682b136-ed23-4c32-9087-6c329f9f678b None admin] RBAC: Adding query filter params (name=image) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:32.000461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682b136-ed23-4c32-9087-6c329f9f678b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:32.002675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682b136-ed23-4c32-9087-6c329f9f678b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:32.008642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 512/1016] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:32.014311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682b136-ed23-4c32-9087-6c329f9f678b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:32.033879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fd11f-bf12-4ca0-b237-37767a5b5771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:32.035074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fd11f-bf12-4ca0-b237-37767a5b5771 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.035349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fd11f-bf12-4ca0-b237-37767a5b5771 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.035618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fd11f-bf12-4ca0-b237-37767a5b5771 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.036196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fd11f-bf12-4ca0-b237-37767a5b5771 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:32.037576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fd11f-bf12-4ca0-b237-37767a5b5771 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-a86fd11f-bf12-4ca0-b237-37767a5b5771 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:32.048566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:32.050660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:32.051701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 505/1017] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:32.056675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fd11f-bf12-4ca0-b237-37767a5b5771 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:32.138219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682b136-ed23-4c32-9087-6c329f9f678b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:32.158009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:32.167839 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fd11f-bf12-4ca0-b237-37767a5b5771 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:32.176544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64822963-7827-479c-be4f-27ad03340a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:32.177470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64822963-7827-479c-be4f-27ad03340a5d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.177847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64822963-7827-479c-be4f-27ad03340a5d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.178121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64822963-7827-479c-be4f-27ad03340a5d None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.178980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64822963-7827-479c-be4f-27ad03340a5d None admin] RBAC: Adding query filter params (type=image) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:32.179090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64822963-7827-479c-be4f-27ad03340a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:32.180380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64822963-7827-479c-be4f-27ad03340a5d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:32.185594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 513/1018] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:32.191957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64822963-7827-479c-be4f-27ad03340a5d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:32.202466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545979d6-0611-4994-a5d0-0a520ad86a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:32.203074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545979d6-0611-4994-a5d0-0a520ad86a83 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.203349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545979d6-0611-4994-a5d0-0a520ad86a83 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.203618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545979d6-0611-4994-a5d0-0a520ad86a83 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.204242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545979d6-0611-4994-a5d0-0a520ad86a83 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:32.204541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545979d6-0611-4994-a5d0-0a520ad86a83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:32.205974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545979d6-0611-4994-a5d0-0a520ad86a83 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:32.213356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 506/1019] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:32.217153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:32.219072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545979d6-0611-4994-a5d0-0a520ad86a83 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:32.305779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64822963-7827-479c-be4f-27ad03340a5d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:32.326161 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545979d6-0611-4994-a5d0-0a520ad86a83 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:32.343336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43fd9-bafc-45a4-be14-4e5fb11a9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:32.343940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43fd9-bafc-45a4-be14-4e5fb11a9105 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.344219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43fd9-bafc-45a4-be14-4e5fb11a9105 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.344493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43fd9-bafc-45a4-be14-4e5fb11a9105 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.345193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b43fd9-bafc-45a4-be14-4e5fb11a9105 None admin] RBAC: Adding query filter params (interface=public, service_id=598047f8141f4a4aa54e13490ca5a1f4, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:32.345528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b43fd9-bafc-45a4-be14-4e5fb11a9105 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:32.347056 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b43fd9-bafc-45a4-be14-4e5fb11a9105 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:32.353025 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 514/1020] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Aug 10 22:42:32 2022] GET /identity/v3/endpoints?service_id=598047f8141f4a4aa54e13490ca5a1f4&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:32.358394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43fd9-bafc-45a4-be14-4e5fb11a9105 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:32.364988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78df8a-9add-4821-b2e0-c45fc896e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:32.365629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78df8a-9add-4821-b2e0-c45fc896e33a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.365906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78df8a-9add-4821-b2e0-c45fc896e33a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.366178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78df8a-9add-4821-b2e0-c45fc896e33a None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.366796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78df8a-9add-4821-b2e0-c45fc896e33a None admin] RBAC: Adding query filter params (type=compute) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:32.367339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78df8a-9add-4821-b2e0-c45fc896e33a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:32.368464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78df8a-9add-4821-b2e0-c45fc896e33a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:32.373649 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 507/1021] 10.222.0.77 () {56 vars in 1112 bytes} [Wed Aug 10 22:42:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:32.379653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78df8a-9add-4821-b2e0-c45fc896e33a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:32.405182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:32.450644 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:32.470599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43fd9-bafc-45a4-be14-4e5fb11a9105 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:32.491960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78df8a-9add-4821-b2e0-c45fc896e33a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:32.506361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866a6a6-78df-4cbc-9adb-836cbef3c7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:32.506957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866a6a6-78df-4cbc-9adb-836cbef3c7e4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.507226 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866a6a6-78df-4cbc-9adb-836cbef3c7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.507497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866a6a6-78df-4cbc-9adb-836cbef3c7e4 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.508090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866a6a6-78df-4cbc-9adb-836cbef3c7e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:32.509466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866a6a6-78df-4cbc-9adb-836cbef3c7e4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:32.515777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 515/1022] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Aug 10 22:42:32 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 22:42:32.516912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817de14-a5f2-49ba-8271-217b4be42a53 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.517180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817de14-a5f2-49ba-8271-217b4be42a53 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.517469 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817de14-a5f2-49ba-8271-217b4be42a53 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.518849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 516/1023] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:32.524405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf3035-19b1-4bc8-b17d-039d6a3749e4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.524683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf3035-19b1-4bc8-b17d-039d6a3749e4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.524957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf3035-19b1-4bc8-b17d-039d6a3749e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.527403 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3358c-8f9c-4c2c-bdcb-ae6eaee1ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:32.528025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3358c-8f9c-4c2c-bdcb-ae6eaee1ded2 None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.528299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3358c-8f9c-4c2c-bdcb-ae6eaee1ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.528562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3358c-8f9c-4c2c-bdcb-ae6eaee1ded2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.529711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3358c-8f9c-4c2c-bdcb-ae6eaee1ded2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:32.530669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3358c-8f9c-4c2c-bdcb-ae6eaee1ded2 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:32.544080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-06cf3035-19b1-4bc8-b17d-039d6a3749e4 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:32.545303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-06cf3035-19b1-4bc8-b17d-039d6a3749e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:32.623122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 517/1024] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:32 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:32.641819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 508/1025] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 22:42:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:42:32.647518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf3035-19b1-4bc8-b17d-039d6a3749e4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:32.743638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:32.774248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf3035-19b1-4bc8-b17d-039d6a3749e4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:32.823006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fcf2c-7015-4723-821a-4bfa11f9e1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:32.823654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fcf2c-7015-4723-821a-4bfa11f9e1bf None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.823925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fcf2c-7015-4723-821a-4bfa11f9e1bf None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.824250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fcf2c-7015-4723-821a-4bfa11f9e1bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.825795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fcf2c-7015-4723-821a-4bfa11f9e1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:32.827225 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fcf2c-7015-4723-821a-4bfa11f9e1bf None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:32.828809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 518/1026] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:32.834652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3358c-8f9c-4c2c-bdcb-ae6eaee1ded2 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:32.915800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:32.941817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3358c-8f9c-4c2c-bdcb-ae6eaee1ded2 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:32.977676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b18b5-98c6-4e71-b129-d241fbd2f2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:32.978290 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b18b5-98c6-4e71-b129-d241fbd2f2e3 None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:32.978564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b18b5-98c6-4e71-b129-d241fbd2f2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:32.978831 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b18b5-98c6-4e71-b129-d241fbd2f2e3 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:32.979480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b18b5-98c6-4e71-b129-d241fbd2f2e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:32.980897 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b18b5-98c6-4e71-b129-d241fbd2f2e3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:33.065471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 509/1027] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:42:32 2022] POST /identity/v3/projects => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:42:34.527569 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf53c2f-d601-4afc-88fc-3e5d0e963266 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:34.528131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf53c2f-d601-4afc-88fc-3e5d0e963266 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:34.528131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf53c2f-d601-4afc-88fc-3e5d0e963266 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:34.529584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 519/1028] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:34.535292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cec6ac-9442-4541-bc45-b07a94711d17 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:34.535805 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cec6ac-9442-4541-bc45-b07a94711d17 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:34.535883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cec6ac-9442-4541-bc45-b07a94711d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:34.554352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-12cec6ac-9442-4541-bc45-b07a94711d17 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:34.555576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-12cec6ac-9442-4541-bc45-b07a94711d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:34.638570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 510/1029] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:34.660967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf53c2f-d601-4afc-88fc-3e5d0e963266 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:34.768914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf53c2f-d601-4afc-88fc-3e5d0e963266 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:34.776996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9f36a-898c-4237-8b73-0c2c5231d15b None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:34.777277 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9f36a-898c-4237-8b73-0c2c5231d15b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:34.777642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9f36a-898c-4237-8b73-0c2c5231d15b None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:34.779141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 511/1030] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:34.784707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7397d-0cd9-411b-9eba-d911e4c65904 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:34.785060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7397d-0cd9-411b-9eba-d911e4c65904 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:34.785429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7397d-0cd9-411b-9eba-d911e4c65904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:34.803097 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-07f7397d-0cd9-411b-9eba-d911e4c65904 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:34.804333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-07f7397d-0cd9-411b-9eba-d911e4c65904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:34.805904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8269956-9195-4352-a5df-65cfab82b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:34.806534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269956-9195-4352-a5df-65cfab82b63e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:34.806808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269956-9195-4352-a5df-65cfab82b63e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:34.807076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8269956-9195-4352-a5df-65cfab82b63e None admin] PATH_INFO: `/v3/services/image` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:34.807653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8269956-9195-4352-a5df-65cfab82b63e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:34.809003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8269956-9195-4352-a5df-65cfab82b63e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-c8269956-9195-4352-a5df-65cfab82b63e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:34.817875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:34.818866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 22:42:34.819710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:34.824086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 520/1031] 10.222.0.77 () {56 vars in 1105 bytes} [Wed Aug 10 22:42:34 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:34.824721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8269956-9195-4352-a5df-65cfab82b63e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:34.827429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:34.857607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:34.874766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 512/1032] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:34.898250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7397d-0cd9-411b-9eba-d911e4c65904 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:34.941265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8269956-9195-4352-a5df-65cfab82b63e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:34.979982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480f1d-6f15-4fc3-91ad-88c5e722d430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:34.980747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480f1d-6f15-4fc3-91ad-88c5e722d430 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:34.980858 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480f1d-6f15-4fc3-91ad-88c5e722d430 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:34.981107 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480f1d-6f15-4fc3-91ad-88c5e722d430 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:34.981758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480f1d-6f15-4fc3-91ad-88c5e722d430 None admin] RBAC: Adding query filter params (name=image) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:34.982055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480f1d-6f15-4fc3-91ad-88c5e722d430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:34.983406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480f1d-6f15-4fc3-91ad-88c5e722d430 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:34.988816 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 521/1033] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:34.994218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480f1d-6f15-4fc3-91ad-88c5e722d430 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:35.004292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7397d-0cd9-411b-9eba-d911e4c65904 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:35.041588 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fcc73-5af6-4238-81e5-4e2dc08aa51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:35.042137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fcc73-5af6-4238-81e5-4e2dc08aa51a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.042410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fcc73-5af6-4238-81e5-4e2dc08aa51a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.042675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fcc73-5af6-4238-81e5-4e2dc08aa51a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.054008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fcc73-5af6-4238-81e5-4e2dc08aa51a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-a62fcc73-5af6-4238-81e5-4e2dc08aa51a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:35.058711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:35.059670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:35.060511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 513/1034] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Aug 10 22:42:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:35.065676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fcc73-5af6-4238-81e5-4e2dc08aa51a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:35.066150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:35.104068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480f1d-6f15-4fc3-91ad-88c5e722d430 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:35.115590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:35.139624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c72302-9f04-4932-b028-cbac3e169d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:35.140219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c72302-9f04-4932-b028-cbac3e169d95 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.140486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c72302-9f04-4932-b028-cbac3e169d95 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.140747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c72302-9f04-4932-b028-cbac3e169d95 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.141394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c72302-9f04-4932-b028-cbac3e169d95 None admin] RBAC: Adding query filter params (type=image) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:35.141690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c72302-9f04-4932-b028-cbac3e169d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:35.143033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c72302-9f04-4932-b028-cbac3e169d95 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:35.148309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 522/1035] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:35.149623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51976d5e-2ccb-4dae-911c-1d27166c0c86 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.149902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51976d5e-2ccb-4dae-911c-1d27166c0c86 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.150166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51976d5e-2ccb-4dae-911c-1d27166c0c86 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.151552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 523/1036] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:35.154006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51976d5e-2ccb-4dae-911c-1d27166c0c86 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:35.169633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fcc73-5af6-4238-81e5-4e2dc08aa51a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:35.204537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bf88b-4533-400c-8cda-ea8a4d16c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:35.205149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bf88b-4533-400c-8cda-ea8a4d16c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.205456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bf88b-4533-400c-8cda-ea8a4d16c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.205731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bf88b-4533-400c-8cda-ea8a4d16c6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.206950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bf88b-4533-400c-8cda-ea8a4d16c6a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:35.207249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bf88b-4533-400c-8cda-ea8a4d16c6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:35.208596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bf88b-4533-400c-8cda-ea8a4d16c6a5 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:35.216931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 514/1037] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Aug 10 22:42:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:35.216931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5676c-7431-45d9-b7b0-dfd8f10aa53d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.216931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5676c-7431-45d9-b7b0-dfd8f10aa53d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.216931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5676c-7431-45d9-b7b0-dfd8f10aa53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.236502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-eaf5676c-7431-45d9-b7b0-dfd8f10aa53d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:35.237735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-eaf5676c-7431-45d9-b7b0-dfd8f10aa53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:35.258160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51976d5e-2ccb-4dae-911c-1d27166c0c86 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:35.287019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:35.293072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd57f4-60ff-465f-8cfe-b1eea40100d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:35.293640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd57f4-60ff-465f-8cfe-b1eea40100d5 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.293923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd57f4-60ff-465f-8cfe-b1eea40100d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.294197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd57f4-60ff-465f-8cfe-b1eea40100d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.294851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd57f4-60ff-465f-8cfe-b1eea40100d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:35.299621 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd57f4-60ff-465f-8cfe-b1eea40100d5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:35.304521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 515/1038] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:35.305137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5676c-7431-45d9-b7b0-dfd8f10aa53d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:35.345641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:35.376893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 524/1039] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 22:42:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:42:35.378579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd57f4-60ff-465f-8cfe-b1eea40100d5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:35.415615 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5676c-7431-45d9-b7b0-dfd8f10aa53d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:35.464943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c87912-1d59-45c9-b9b3-d3c291d9e7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:35.465625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c87912-1d59-45c9-b9b3-d3c291d9e7ae None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.465896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c87912-1d59-45c9-b9b3-d3c291d9e7ae None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.466160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c87912-1d59-45c9-b9b3-d3c291d9e7ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.479887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c87912-1d59-45c9-b9b3-d3c291d9e7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:35.481842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c87912-1d59-45c9-b9b3-d3c291d9e7ae None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-33c87912-1d59-45c9-b9b3-d3c291d9e7ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:35.498216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:35.499253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:35.500133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:35.500133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:35.500133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:35.500133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 516/1040] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:35.506460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c87912-1d59-45c9-b9b3-d3c291d9e7ae None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:35.509421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd57f4-60ff-465f-8cfe-b1eea40100d5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:35.559759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d665d3-9579-4939-bf56-a58ecdd0ead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:35.560363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d665d3-9579-4939-bf56-a58ecdd0ead5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.560524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d665d3-9579-4939-bf56-a58ecdd0ead5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.560792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d665d3-9579-4939-bf56-a58ecdd0ead5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.562002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d665d3-9579-4939-bf56-a58ecdd0ead5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:35.563484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d665d3-9579-4939-bf56-a58ecdd0ead5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:35.565055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 525/1041] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:35.580288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d665d3-9579-4939-bf56-a58ecdd0ead5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:35.630157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:35.649262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c87912-1d59-45c9-b9b3-d3c291d9e7ae None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:35.659940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:35.695902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1b7d-a819-44d3-8e6d-c1580f9ac969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:35.696512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1b7d-a819-44d3-8e6d-c1580f9ac969 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.696787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1b7d-a819-44d3-8e6d-c1580f9ac969 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.697444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1b7d-a819-44d3-8e6d-c1580f9ac969 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.697758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1b7d-a819-44d3-8e6d-c1580f9ac969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:35.698031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1b7d-a819-44d3-8e6d-c1580f9ac969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:35.699390 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1b7d-a819-44d3-8e6d-c1580f9ac969 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:35.711067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d665d3-9579-4939-bf56-a58ecdd0ead5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:35.712654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 517/1042] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:35.718172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1b7d-a819-44d3-8e6d-c1580f9ac969 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:35.754448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80335db5-7bd8-4cf9-8b27-a8ca8ecdc2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:35.755096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80335db5-7bd8-4cf9-8b27-a8ca8ecdc2e2 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.755409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80335db5-7bd8-4cf9-8b27-a8ca8ecdc2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.755628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80335db5-7bd8-4cf9-8b27-a8ca8ecdc2e2 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.756275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80335db5-7bd8-4cf9-8b27-a8ca8ecdc2e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:35.758812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80335db5-7bd8-4cf9-8b27-a8ca8ecdc2e2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:35.840107 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1b7d-a819-44d3-8e6d-c1580f9ac969 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:35.874373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ea539-ab8c-474d-93bf-7a3c752a740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:35.875000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ea539-ab8c-474d-93bf-7a3c752a740f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:35.875275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ea539-ab8c-474d-93bf-7a3c752a740f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:35.875544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ea539-ab8c-474d-93bf-7a3c752a740f None admin] PATH_INFO: `/v3/users/nova` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:35.885938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ea539-ab8c-474d-93bf-7a3c752a740f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:35.888693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ea539-ab8c-474d-93bf-7a3c752a740f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:35.894337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 526/1043] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:42:35 2022] POST /identity/v3/users => generated 285 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-fe2ea539-ab8c-474d-93bf-7a3c752a740f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:35.901469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:35.902515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:35.903519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:35.903519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:35.903519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:35.903519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:35.903519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:35.903519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:35.903519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:35.903519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:35.903519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:42:35.903519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:35.905704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 518/1044] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Aug 10 22:42:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:35.908966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80335db5-7bd8-4cf9-8b27-a8ca8ecdc2e2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:36.026656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80335db5-7bd8-4cf9-8b27-a8ca8ecdc2e2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:36.038419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:36.063796 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1a72f-6b18-488c-8e28-3750ea32d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:36.064405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a72f-6b18-488c-8e28-3750ea32d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:36.064679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a72f-6b18-488c-8e28-3750ea32d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:36.064943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a72f-6b18-488c-8e28-3750ea32d2a6 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:36.066226 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1a72f-6b18-488c-8e28-3750ea32d2a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:36.066524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1a72f-6b18-488c-8e28-3750ea32d2a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:36.067953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1a72f-6b18-488c-8e28-3750ea32d2a6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:36.088079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 527/1045] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Aug 10 22:42:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:36.093960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ea539-ab8c-474d-93bf-7a3c752a740f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:36.105377 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:36.204856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ea539-ab8c-474d-93bf-7a3c752a740f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:36.240255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b86cd-85e8-4578-85cb-6572ea164e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:36.240852 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b86cd-85e8-4578-85cb-6572ea164e62 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:36.241122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b86cd-85e8-4578-85cb-6572ea164e62 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:36.241469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b86cd-85e8-4578-85cb-6572ea164e62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:36.308467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b86cd-85e8-4578-85cb-6572ea164e62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:36.310130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b86cd-85e8-4578-85cb-6572ea164e62 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:36.319262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:36.412066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 519/1046] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 22:42:36.417611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1a72f-6b18-488c-8e28-3750ea32d2a6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:36.524159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1a72f-6b18-488c-8e28-3750ea32d2a6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:36.567860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aa36a-cb59-4a89-a9ab-7844d022d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:36.568534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aa36a-cb59-4a89-a9ab-7844d022d178 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:36.568751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aa36a-cb59-4a89-a9ab-7844d022d178 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:36.569012 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aa36a-cb59-4a89-a9ab-7844d022d178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:36.579713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79aa36a-cb59-4a89-a9ab-7844d022d178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:36.581233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79aa36a-cb59-4a89-a9ab-7844d022d178 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f79aa36a-cb59-4a89-a9ab-7844d022d178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:36.595909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:36.596971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:36.598827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:36.598827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:36.598827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:36.598827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 528/1047] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:36.603021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b86cd-85e8-4578-85cb-6572ea164e62 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:36.715793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b86cd-85e8-4578-85cb-6572ea164e62 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:36.724309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:36.752024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd3c84-5528-4c4a-87a1-f72831880b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:36.752651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd3c84-5528-4c4a-87a1-f72831880b9e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:36.752928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd3c84-5528-4c4a-87a1-f72831880b9e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:36.753199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd3c84-5528-4c4a-87a1-f72831880b9e None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:36.753873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd3c84-5528-4c4a-87a1-f72831880b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:36.754207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd3c84-5528-4c4a-87a1-f72831880b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:36.755529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd3c84-5528-4c4a-87a1-f72831880b9e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:36.773473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 520/1048] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:36.778814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aa36a-cb59-4a89-a9ab-7844d022d178 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:36.803303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:36.882677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aa36a-cb59-4a89-a9ab-7844d022d178 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:36.916810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586b8d-92c7-4728-9e31-681dab5cd450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:36.917455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586b8d-92c7-4728-9e31-681dab5cd450 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:36.917731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586b8d-92c7-4728-9e31-681dab5cd450 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:36.917996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586b8d-92c7-4728-9e31-681dab5cd450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:36.925215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4586b8d-92c7-4728-9e31-681dab5cd450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:36.926662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4586b8d-92c7-4728-9e31-681dab5cd450 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-d4586b8d-92c7-4728-9e31-681dab5cd450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:36.937695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:36.938620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:36.939502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:36.939502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:36.939502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:36.939502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:36.939502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:36.939502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:36.939502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:36.939502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:36.939502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 529/1049] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:36.946113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd3c84-5528-4c4a-87a1-f72831880b9e None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:37.047774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd3c84-5528-4c4a-87a1-f72831880b9e None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:37.081615 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fbc0f-7f26-4118-94c5-a81471d53ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:37.082210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fbc0f-7f26-4118-94c5-a81471d53ae7 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:37.082482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fbc0f-7f26-4118-94c5-a81471d53ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:37.082747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fbc0f-7f26-4118-94c5-a81471d53ae7 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:37.083490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fbc0f-7f26-4118-94c5-a81471d53ae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:37.083790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fbc0f-7f26-4118-94c5-a81471d53ae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:37.085211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fbc0f-7f26-4118-94c5-a81471d53ae7 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:37.104282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 521/1050] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:37.105598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586b8d-92c7-4728-9e31-681dab5cd450 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:37.188657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:37.214917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586b8d-92c7-4728-9e31-681dab5cd450 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:37.250364 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f70be-59cb-4094-a4c7-b38e33b50a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:37.250958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f70be-59cb-4094-a4c7-b38e33b50a9d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:37.251231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f70be-59cb-4094-a4c7-b38e33b50a9d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:37.251497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f70be-59cb-4094-a4c7-b38e33b50a9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:37.252218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f70be-59cb-4094-a4c7-b38e33b50a9d None admin] RBAC: Adding query filter params (role.id=0de4cd838d5c4fc1accf3463cffd2283, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=34568b830fc641edab39324047368546) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:37.252518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f70be-59cb-4094-a4c7-b38e33b50a9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:37.253954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f70be-59cb-4094-a4c7-b38e33b50a9d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:37.261649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 530/1051] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:37 2022] GET /identity/v3/role_assignments?user.id=34568b830fc641edab39324047368546&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=0de4cd838d5c4fc1accf3463cffd2283 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:37.490698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693844-7098-4c85-9ef6-5973a31cc414 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:37.491144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693844-7098-4c85-9ef6-5973a31cc414 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:37.491348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12693844-7098-4c85-9ef6-5973a31cc414 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:37.492774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 522/1052] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:37.498240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec25fe-2320-489e-b4f6-2226be0d738c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:37.498570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec25fe-2320-489e-b4f6-2226be0d738c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:37.498938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec25fe-2320-489e-b4f6-2226be0d738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:37.517782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b8ec25fe-2320-489e-b4f6-2226be0d738c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:37.519534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b8ec25fe-2320-489e-b4f6-2226be0d738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:37.591671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 531/1053] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:37.614756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12693844-7098-4c85-9ef6-5973a31cc414 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:37.642607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:37.719661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12693844-7098-4c85-9ef6-5973a31cc414 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:37.755791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de5467-0860-41ac-b21e-6688615f0505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:37.756296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de5467-0860-41ac-b21e-6688615f0505 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:37.756565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de5467-0860-41ac-b21e-6688615f0505 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:37.756826 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de5467-0860-41ac-b21e-6688615f0505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:37.831702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de5467-0860-41ac-b21e-6688615f0505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:37.833141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de5467-0860-41ac-b21e-6688615f0505 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:37.859841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:37.937450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 523/1054] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:42:37.940529 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec25fe-2320-489e-b4f6-2226be0d738c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:38.003191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df87386-3b1e-4cc1-846b-5d5c6d41fad0 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:38.003504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df87386-3b1e-4cc1-846b-5d5c6d41fad0 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:38.003776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df87386-3b1e-4cc1-846b-5d5c6d41fad0 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:38.005254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 524/1055] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:38.010634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9b7ae-1ba1-4c44-9929-5c19de2d27fc None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:38.011115 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9b7ae-1ba1-4c44-9929-5c19de2d27fc None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:38.011554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9b7ae-1ba1-4c44-9929-5c19de2d27fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:38.019152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:38.030383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c8c9b7ae-1ba1-4c44-9929-5c19de2d27fc None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:38.031793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c8c9b7ae-1ba1-4c44-9929-5c19de2d27fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:38.047093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec25fe-2320-489e-b4f6-2226be0d738c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:38.083230 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2d698-cab6-4b10-be09-f4e8a5bcbd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:38.083844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2d698-cab6-4b10-be09-f4e8a5bcbd5b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:38.084114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2d698-cab6-4b10-be09-f4e8a5bcbd5b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:38.084375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2d698-cab6-4b10-be09-f4e8a5bcbd5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:38.094927 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2d698-cab6-4b10-be09-f4e8a5bcbd5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:38.096906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2d698-cab6-4b10-be09-f4e8a5bcbd5b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:38.099952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 525/1056] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-aac2d698-cab6-4b10-be09-f4e8a5bcbd5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:38.113531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:38.114484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:38.120229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:38.120229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:38.120229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:38.120229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 532/1057] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:38.121956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9b7ae-1ba1-4c44-9929-5c19de2d27fc None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:38.122111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2d698-cab6-4b10-be09-f4e8a5bcbd5b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:38.179796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:38.227359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9b7ae-1ba1-4c44-9929-5c19de2d27fc None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:38.228765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2d698-cab6-4b10-be09-f4e8a5bcbd5b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:38.255980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:38.263938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abb781-1526-494c-945c-f69e328d02a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:38.264097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f477e1-7eb7-440e-83cd-fea69bb3de23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:38.264480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb781-1526-494c-945c-f69e328d02a9 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:38.264681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f477e1-7eb7-440e-83cd-fea69bb3de23 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:38.264779 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb781-1526-494c-945c-f69e328d02a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:38.264954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f477e1-7eb7-440e-83cd-fea69bb3de23 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:38.265050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb781-1526-494c-945c-f69e328d02a9 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:38.265220 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f477e1-7eb7-440e-83cd-fea69bb3de23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:38.265725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abb781-1526-494c-945c-f69e328d02a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:38.265964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abb781-1526-494c-945c-f69e328d02a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:38.267305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abb781-1526-494c-945c-f69e328d02a9 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:38.276919 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f477e1-7eb7-440e-83cd-fea69bb3de23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:38.279945 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 526/1058] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-d6f477e1-7eb7-440e-83cd-fea69bb3de23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:38.281679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:38.282581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:38.283590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:38.288157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 533/1059] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:42:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:38.289147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abb781-1526-494c-945c-f69e328d02a9 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:38.462421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abb781-1526-494c-945c-f69e328d02a9 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:38.479604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:38.499968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376cf3-2ed8-4c4a-b935-e3d759d263d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:38.500579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376cf3-2ed8-4c4a-b935-e3d759d263d6 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:38.500857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376cf3-2ed8-4c4a-b935-e3d759d263d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:38.501122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97376cf3-2ed8-4c4a-b935-e3d759d263d6 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:38.501842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97376cf3-2ed8-4c4a-b935-e3d759d263d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:38.502138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97376cf3-2ed8-4c4a-b935-e3d759d263d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:38.504139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97376cf3-2ed8-4c4a-b935-e3d759d263d6 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:38.513342 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 527/1060] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:42:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:38.519788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f477e1-7eb7-440e-83cd-fea69bb3de23 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:38.627742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f477e1-7eb7-440e-83cd-fea69bb3de23 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:38.663914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b6f35-b0d8-4576-b379-7fdd3954c385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:38.664541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6f35-b0d8-4576-b379-7fdd3954c385 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:38.664813 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6f35-b0d8-4576-b379-7fdd3954c385 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:38.665081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6f35-b0d8-4576-b379-7fdd3954c385 None admin] PATH_INFO: `/v3/users/4dafe9582bf3449496f67eb46529ab54` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:38.678969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b6f35-b0d8-4576-b379-7fdd3954c385 None admin] RBAC: Authorizing `identity:get_user(user_id=4dafe9582bf3449496f67eb46529ab54)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:38.680415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b6f35-b0d8-4576-b379-7fdd3954c385 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:38.682114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 534/1061] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:42:38 2022] GET /identity/v3/users/4dafe9582bf3449496f67eb46529ab54 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:38.687892 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376cf3-2ed8-4c4a-b935-e3d759d263d6 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:38.792870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97376cf3-2ed8-4c4a-b935-e3d759d263d6 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:38.838721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52206fe-eb6a-4a5b-a6bb-0b40d6e058b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:38.839325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52206fe-eb6a-4a5b-a6bb-0b40d6e058b8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:38.839599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52206fe-eb6a-4a5b-a6bb-0b40d6e058b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:38.839865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52206fe-eb6a-4a5b-a6bb-0b40d6e058b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:38.885018 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:38.906346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52206fe-eb6a-4a5b-a6bb-0b40d6e058b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:38.907872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52206fe-eb6a-4a5b-a6bb-0b40d6e058b8 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:39.004258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 528/1062] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 22:42:39.010222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b6f35-b0d8-4576-b379-7fdd3954c385 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:39.056366 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:39.109371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b6f35-b0d8-4576-b379-7fdd3954c385 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:39.145711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c2521-6b03-4563-a7a4-d4df37616f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:39.146337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c2521-6b03-4563-a7a4-d4df37616f57 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:39.146607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c2521-6b03-4563-a7a4-d4df37616f57 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:39.146879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c2521-6b03-4563-a7a4-d4df37616f57 None admin] PATH_INFO: `/v3/projects/feea915668784250b78e397240dc3e53` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:39.148224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c2521-6b03-4563-a7a4-d4df37616f57 None admin] RBAC: Authorizing `identity:get_project(project_id=feea915668784250b78e397240dc3e53)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:39.149686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c2521-6b03-4563-a7a4-d4df37616f57 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:39.151283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 535/1063] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:42:39 2022] GET /identity/v3/projects/feea915668784250b78e397240dc3e53 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:39.157546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52206fe-eb6a-4a5b-a6bb-0b40d6e058b8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:39.246364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:39.268813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52206fe-eb6a-4a5b-a6bb-0b40d6e058b8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:39.283361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7037c38-7787-4022-9b4f-0acff8922488 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:39.283638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7037c38-7787-4022-9b4f-0acff8922488 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:39.283955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7037c38-7787-4022-9b4f-0acff8922488 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:39.285302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 536/1064] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:39.290327 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85a767-4495-4300-b8ea-f609c5035624 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:39.290609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85a767-4495-4300-b8ea-f609c5035624 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:39.290883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85a767-4495-4300-b8ea-f609c5035624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:39.303933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1e947-add1-44bc-bcdc-1738107ab31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:39.304529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e947-add1-44bc-bcdc-1738107ab31a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:39.304799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e947-add1-44bc-bcdc-1738107ab31a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:39.305064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1e947-add1-44bc-bcdc-1738107ab31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:39.305802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1e947-add1-44bc-bcdc-1738107ab31a None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=feea915668784250b78e397240dc3e53, user.id=4dafe9582bf3449496f67eb46529ab54) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:39.306101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1e947-add1-44bc-bcdc-1738107ab31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:39.307577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1e947-add1-44bc-bcdc-1738107ab31a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:39.308952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9d85a767-4495-4300-b8ea-f609c5035624 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:39.310210 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9d85a767-4495-4300-b8ea-f609c5035624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:39.313221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 529/1065] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:39 2022] GET /identity/v3/role_assignments?user.id=4dafe9582bf3449496f67eb46529ab54&scope.project.id=feea915668784250b78e397240dc3e53&role.id=edba0d8c079245a38a321d2d77d25419 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:39.385066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 537/1066] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:39.407555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1e947-add1-44bc-bcdc-1738107ab31a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:39.525427 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1e947-add1-44bc-bcdc-1738107ab31a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:39.561203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a671f4c-ea15-4000-9918-36f9b71f6397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:39.561802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a671f4c-ea15-4000-9918-36f9b71f6397 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:39.562074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a671f4c-ea15-4000-9918-36f9b71f6397 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:39.562340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a671f4c-ea15-4000-9918-36f9b71f6397 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:39.572888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a671f4c-ea15-4000-9918-36f9b71f6397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-6a671f4c-ea15-4000-9918-36f9b71f6397 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:39.577596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:39.578527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:39.579380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 530/1067] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Aug 10 22:42:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:39.584695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85a767-4495-4300-b8ea-f609c5035624 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:39.626765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:39.684144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85a767-4495-4300-b8ea-f609c5035624 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:39.717031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee0d71-1be1-41f5-8e5c-e37a1573012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:39.717648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee0d71-1be1-41f5-8e5c-e37a1573012a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:39.717916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee0d71-1be1-41f5-8e5c-e37a1573012a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:39.718177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee0d71-1be1-41f5-8e5c-e37a1573012a None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:39.718824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee0d71-1be1-41f5-8e5c-e37a1573012a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:39.719116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee0d71-1be1-41f5-8e5c-e37a1573012a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:39.720461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee0d71-1be1-41f5-8e5c-e37a1573012a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:39.729202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 538/1068] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Aug 10 22:42:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:39.734956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a671f4c-ea15-4000-9918-36f9b71f6397 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:39.739129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:39.835844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a671f4c-ea15-4000-9918-36f9b71f6397 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:39.869756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4b7be-aba4-44c4-bc17-8e774d488e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:39.870372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4b7be-aba4-44c4-bc17-8e774d488e2e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:39.870648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4b7be-aba4-44c4-bc17-8e774d488e2e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:39.870923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4b7be-aba4-44c4-bc17-8e774d488e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:39.880574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4b7be-aba4-44c4-bc17-8e774d488e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:39.882017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4b7be-aba4-44c4-bc17-8e774d488e2e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-84c4b7be-aba4-44c4-bc17-8e774d488e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:39.896041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:39.897034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:39.897981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:39.897981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:39.897981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:39.897981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 531/1069] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:39.903022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee0d71-1be1-41f5-8e5c-e37a1573012a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:40.001543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee0d71-1be1-41f5-8e5c-e37a1573012a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:40.003901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:40.035904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cf874-ef7f-4a17-9584-b1c9a0d522ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:40.036499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cf874-ef7f-4a17-9584-b1c9a0d522ac None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:40.036772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cf874-ef7f-4a17-9584-b1c9a0d522ac None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:40.037036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cf874-ef7f-4a17-9584-b1c9a0d522ac None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:40.037752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cf874-ef7f-4a17-9584-b1c9a0d522ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:40.038053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cf874-ef7f-4a17-9584-b1c9a0d522ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:40.039408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cf874-ef7f-4a17-9584-b1c9a0d522ac None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:40.051440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 539/1070] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:40.057020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4b7be-aba4-44c4-bc17-8e774d488e2e None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:40.112734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:40.156829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4b7be-aba4-44c4-bc17-8e774d488e2e None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:40.190094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64709c-fdb6-4abc-9346-43682ac08b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:40.190722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64709c-fdb6-4abc-9346-43682ac08b65 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:40.191000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64709c-fdb6-4abc-9346-43682ac08b65 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:40.191269 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64709c-fdb6-4abc-9346-43682ac08b65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:40.198844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64709c-fdb6-4abc-9346-43682ac08b65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:40.200266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64709c-fdb6-4abc-9346-43682ac08b65 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-8c64709c-fdb6-4abc-9346-43682ac08b65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:40.211687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:40.212673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:40.213982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 532/1071] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Aug 10 22:42:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:40.218507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cf874-ef7f-4a17-9584-b1c9a0d522ac None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:40.317166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cf874-ef7f-4a17-9584-b1c9a0d522ac None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:40.352364 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef4dc7-d91d-4bf1-959e-73085ef393f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:40.352972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef4dc7-d91d-4bf1-959e-73085ef393f4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:40.353256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef4dc7-d91d-4bf1-959e-73085ef393f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:40.353664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef4dc7-d91d-4bf1-959e-73085ef393f4 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:40.354402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef4dc7-d91d-4bf1-959e-73085ef393f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:40.354706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef4dc7-d91d-4bf1-959e-73085ef393f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:40.356134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef4dc7-d91d-4bf1-959e-73085ef393f4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:40.401993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 540/1072] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Aug 10 22:42:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:40.407754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64709c-fdb6-4abc-9346-43682ac08b65 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:40.509007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64709c-fdb6-4abc-9346-43682ac08b65 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:40.523113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:40.542065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92468d02-6252-4a4c-92e1-bfa5f484d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:40.542846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468d02-6252-4a4c-92e1-bfa5f484d1cf None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:40.543163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468d02-6252-4a4c-92e1-bfa5f484d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:40.543426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468d02-6252-4a4c-92e1-bfa5f484d1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:40.558453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92468d02-6252-4a4c-92e1-bfa5f484d1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:40.560356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92468d02-6252-4a4c-92e1-bfa5f484d1cf None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-92468d02-6252-4a4c-92e1-bfa5f484d1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:40.574643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:40.575810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:40.576754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:40.576754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:40.576754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:40.576754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 533/1073] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:40.582278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef4dc7-d91d-4bf1-959e-73085ef393f4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:40.606397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:40.687284 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef4dc7-d91d-4bf1-959e-73085ef393f4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:40.723689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c0a7d-6978-4ce4-8855-0ff25d43f97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:40.724281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0a7d-6978-4ce4-8855-0ff25d43f97f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:40.724550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0a7d-6978-4ce4-8855-0ff25d43f97f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:40.724808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0a7d-6978-4ce4-8855-0ff25d43f97f None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:40.725479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c0a7d-6978-4ce4-8855-0ff25d43f97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:40.725773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c0a7d-6978-4ce4-8855-0ff25d43f97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:40.727109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c0a7d-6978-4ce4-8855-0ff25d43f97f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:40.738573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 541/1074] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:40.744265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92468d02-6252-4a4c-92e1-bfa5f484d1cf None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:40.859109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92468d02-6252-4a4c-92e1-bfa5f484d1cf None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:40.891049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae97401-7f23-4335-a290-fff02fb29bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:40.891660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae97401-7f23-4335-a290-fff02fb29bcb None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:40.891931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae97401-7f23-4335-a290-fff02fb29bcb None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:40.892196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae97401-7f23-4335-a290-fff02fb29bcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:40.899200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae97401-7f23-4335-a290-fff02fb29bcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:40.900618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae97401-7f23-4335-a290-fff02fb29bcb None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-9ae97401-7f23-4335-a290-fff02fb29bcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:40.912095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:40.913004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:40.913934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:40.913934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:40.913934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:40.913934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:40.913934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:40.913934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:40.913934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:40.913934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:40.913934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 534/1075] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:40.918924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c0a7d-6978-4ce4-8855-0ff25d43f97f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:41.000450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:41.019223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c0a7d-6978-4ce4-8855-0ff25d43f97f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:41.051918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68c04c-f263-4084-9ee1-baeda32a85b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:41.052511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c04c-f263-4084-9ee1-baeda32a85b8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:41.052781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c04c-f263-4084-9ee1-baeda32a85b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:41.053042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68c04c-f263-4084-9ee1-baeda32a85b8 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:41.053745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68c04c-f263-4084-9ee1-baeda32a85b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:41.054042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68c04c-f263-4084-9ee1-baeda32a85b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:41.055475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68c04c-f263-4084-9ee1-baeda32a85b8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:41.067419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 542/1076] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:41.073281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae97401-7f23-4335-a290-fff02fb29bcb None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:41.103535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:41.179721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae97401-7f23-4335-a290-fff02fb29bcb None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:41.213578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fc87e-cf27-426a-84a6-271a0f44a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:41.214219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fc87e-cf27-426a-84a6-271a0f44a7dc None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:41.214487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fc87e-cf27-426a-84a6-271a0f44a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:41.214757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fc87e-cf27-426a-84a6-271a0f44a7dc None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/34568b830fc641edab39324047368546/roles/0de4cd838d5c4fc1accf3463cffd2283` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:41.216843 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fc87e-cf27-426a-84a6-271a0f44a7dc None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=34568b830fc641edab39324047368546, role_id=0de4cd838d5c4fc1accf3463cffd2283)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:41.218291 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fc87e-cf27-426a-84a6-271a0f44a7dc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:41.303190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 535/1077] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:42:41 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/34568b830fc641edab39324047368546/roles/0de4cd838d5c4fc1accf3463cffd2283 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:42:41.311692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb6026-4562-47bb-ba0b-d99e3d29100c None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:41.311979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb6026-4562-47bb-ba0b-d99e3d29100c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:41.312252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb6026-4562-47bb-ba0b-d99e3d29100c None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:41.313670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 543/1078] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:41.320406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e09113-2117-49f1-8686-98bdadb12106 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:41.320691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e09113-2117-49f1-8686-98bdadb12106 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:41.320967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e09113-2117-49f1-8686-98bdadb12106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:41.341578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-81e09113-2117-49f1-8686-98bdadb12106 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:41.342784 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-81e09113-2117-49f1-8686-98bdadb12106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:41.425117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 536/1079] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:41.448436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb6026-4562-47bb-ba0b-d99e3d29100c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:41.557698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb6026-4562-47bb-ba0b-d99e3d29100c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:41.592788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f252c7-3def-4091-876c-c8790a78a525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:41.593435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f252c7-3def-4091-876c-c8790a78a525 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:41.593711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f252c7-3def-4091-876c-c8790a78a525 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:41.594075 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f252c7-3def-4091-876c-c8790a78a525 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:41.604924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f252c7-3def-4091-876c-c8790a78a525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-70f252c7-3def-4091-876c-c8790a78a525 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:41.609781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:41.610722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:41.611600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 544/1080] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:41.617773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e09113-2117-49f1-8686-98bdadb12106 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:41.636117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:41.718555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e09113-2117-49f1-8686-98bdadb12106 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:41.753696 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ef960-1cfb-4089-a7ce-783816a6577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:41.754309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef960-1cfb-4089-a7ce-783816a6577a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:41.754584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef960-1cfb-4089-a7ce-783816a6577a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:41.754853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef960-1cfb-4089-a7ce-783816a6577a None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:41.755528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ef960-1cfb-4089-a7ce-783816a6577a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:41.755815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ef960-1cfb-4089-a7ce-783816a6577a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:41.757179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ef960-1cfb-4089-a7ce-783816a6577a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:41.766357 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 537/1081] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:41.772404 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f252c7-3def-4091-876c-c8790a78a525 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:41.776135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:41.880123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f252c7-3def-4091-876c-c8790a78a525 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:41.914045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcf510-2803-42f5-b53d-5f74b150c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:41.914668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcf510-2803-42f5-b53d-5f74b150c3de None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:41.914956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcf510-2803-42f5-b53d-5f74b150c3de None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:41.915217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcf510-2803-42f5-b53d-5f74b150c3de None admin] PATH_INFO: `/v3/users/4dafe9582bf3449496f67eb46529ab54` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:41.916337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcf510-2803-42f5-b53d-5f74b150c3de None admin] RBAC: Authorizing `identity:get_user(user_id=4dafe9582bf3449496f67eb46529ab54)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:41.917798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcf510-2803-42f5-b53d-5f74b150c3de None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:41.919388 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 545/1082] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:42:41 2022] GET /identity/v3/users/4dafe9582bf3449496f67eb46529ab54 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:41.925963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ef960-1cfb-4089-a7ce-783816a6577a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:42.004271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:42.025377 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ef960-1cfb-4089-a7ce-783816a6577a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:42.059977 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bba2a-2d03-4e43-b99b-9b361aa0e69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:42.060597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bba2a-2d03-4e43-b99b-9b361aa0e69b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:42.060869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bba2a-2d03-4e43-b99b-9b361aa0e69b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:42.061137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bba2a-2d03-4e43-b99b-9b361aa0e69b None admin] PATH_INFO: `/v3/projects/feea915668784250b78e397240dc3e53` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:42.062332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bba2a-2d03-4e43-b99b-9b361aa0e69b None admin] RBAC: Authorizing `identity:get_project(project_id=feea915668784250b78e397240dc3e53)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:42.063733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bba2a-2d03-4e43-b99b-9b361aa0e69b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:42.065922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 538/1083] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:42:41 2022] GET /identity/v3/projects/feea915668784250b78e397240dc3e53 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:42.072004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcf510-2803-42f5-b53d-5f74b150c3de None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:42.141007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:42.170449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcf510-2803-42f5-b53d-5f74b150c3de None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:42.204950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bd7b6-46ab-45f4-b567-54853fa1038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:42.206194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bd7b6-46ab-45f4-b567-54853fa1038d None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:42.206470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bd7b6-46ab-45f4-b567-54853fa1038d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:42.206744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bd7b6-46ab-45f4-b567-54853fa1038d None admin] PATH_INFO: `/v3/projects/feea915668784250b78e397240dc3e53/users/4dafe9582bf3449496f67eb46529ab54/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:42.208635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bd7b6-46ab-45f4-b567-54853fa1038d None admin] RBAC: Authorizing `identity:create_grant(project_id=feea915668784250b78e397240dc3e53, user_id=4dafe9582bf3449496f67eb46529ab54, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:42.210111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bd7b6-46ab-45f4-b567-54853fa1038d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:42.279801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 546/1084] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:42:42 2022] PUT /identity/v3/projects/feea915668784250b78e397240dc3e53/users/4dafe9582bf3449496f67eb46529ab54/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:42:43.301089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0caf5-5580-462e-a88b-84beb7c1b7bd None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:43.301772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0caf5-5580-462e-a88b-84beb7c1b7bd None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:43.301772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0caf5-5580-462e-a88b-84beb7c1b7bd None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:43.303128 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 539/1085] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:43.307973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d74293-e34e-447d-9596-d3e62d98ac89 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:43.308416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d74293-e34e-447d-9596-d3e62d98ac89 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:43.308509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d74293-e34e-447d-9596-d3e62d98ac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:43.327358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e7d74293-e34e-447d-9596-d3e62d98ac89 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:43.328514 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e7d74293-e34e-447d-9596-d3e62d98ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:43.396933 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 547/1086] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:43.420487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0caf5-5580-462e-a88b-84beb7c1b7bd None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:43.521444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0caf5-5580-462e-a88b-84beb7c1b7bd None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:43.558591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33f93c-0524-4fcf-a6f0-4f4624710eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:43.559155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33f93c-0524-4fcf-a6f0-4f4624710eac None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:43.559430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33f93c-0524-4fcf-a6f0-4f4624710eac None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:43.559700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33f93c-0524-4fcf-a6f0-4f4624710eac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:43.569970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33f93c-0524-4fcf-a6f0-4f4624710eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5c33f93c-0524-4fcf-a6f0-4f4624710eac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:43.574623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:43.575676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:43.576645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 540/1087] 10.222.0.77 () {56 vars in 1120 bytes} [Wed Aug 10 22:42:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:43.581765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d74293-e34e-447d-9596-d3e62d98ac89 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:43.640913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:43.681924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d74293-e34e-447d-9596-d3e62d98ac89 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:43.715446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cbbf1-70ae-4a84-9f52-6a49d746ed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:43.716040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cbbf1-70ae-4a84-9f52-6a49d746ed10 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:43.716309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cbbf1-70ae-4a84-9f52-6a49d746ed10 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:43.716570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cbbf1-70ae-4a84-9f52-6a49d746ed10 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:43.717220 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cbbf1-70ae-4a84-9f52-6a49d746ed10 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:43.717541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cbbf1-70ae-4a84-9f52-6a49d746ed10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:43.718889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cbbf1-70ae-4a84-9f52-6a49d746ed10 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:43.727388 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 548/1088] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Aug 10 22:42:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:43.732965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33f93c-0524-4fcf-a6f0-4f4624710eac None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:43.743254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:43.839095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33f93c-0524-4fcf-a6f0-4f4624710eac None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:43.873054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46760cc-0450-4306-841d-01fbaef6b517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:43.873701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46760cc-0450-4306-841d-01fbaef6b517 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:43.873976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46760cc-0450-4306-841d-01fbaef6b517 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:43.874242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46760cc-0450-4306-841d-01fbaef6b517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:43.884049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46760cc-0450-4306-841d-01fbaef6b517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:43.885500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46760cc-0450-4306-841d-01fbaef6b517 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-b46760cc-0450-4306-841d-01fbaef6b517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:43.900702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:43.901872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:43.902785 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:43.902785 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:43.902785 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:43.902785 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 541/1089] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:42:43.907999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cbbf1-70ae-4a84-9f52-6a49d746ed10 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:44.006603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cbbf1-70ae-4a84-9f52-6a49d746ed10 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:44.028431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:44.040330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522433-0b40-47c9-ab0a-c651448c73e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:44.040929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522433-0b40-47c9-ab0a-c651448c73e2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:44.041205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522433-0b40-47c9-ab0a-c651448c73e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:44.041530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522433-0b40-47c9-ab0a-c651448c73e2 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:44.042166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522433-0b40-47c9-ab0a-c651448c73e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:44.042465 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522433-0b40-47c9-ab0a-c651448c73e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:44.043836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522433-0b40-47c9-ab0a-c651448c73e2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:44.057014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 549/1090] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:44.062777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46760cc-0450-4306-841d-01fbaef6b517 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:44.124054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:44.165405 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46760cc-0450-4306-841d-01fbaef6b517 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:44.198493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4c87c-406a-47d8-8470-932b41566e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:44.199102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4c87c-406a-47d8-8470-932b41566e6c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:44.199371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4c87c-406a-47d8-8470-932b41566e6c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:44.199635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4c87c-406a-47d8-8470-932b41566e6c None admin] PATH_INFO: `/v3/users/nova` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:44.207661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4c87c-406a-47d8-8470-932b41566e6c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:44.209088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4c87c-406a-47d8-8470-932b41566e6c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-25f4c87c-406a-47d8-8470-932b41566e6c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:42:44.219827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:44.221010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:44.222092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 542/1091] 10.222.0.77 () {56 vars in 1093 bytes} [Wed Aug 10 22:42:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:44.227217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522433-0b40-47c9-ab0a-c651448c73e2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:44.294508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7a78-e78b-436d-8816-4c30fc411a7a None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:44.294783 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7a78-e78b-436d-8816-4c30fc411a7a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:44.295051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7a78-e78b-436d-8816-4c30fc411a7a None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:44.296376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 543/1092] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:44.301443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858980-3321-42a2-9d5e-fd2526003f2c None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:44.302011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858980-3321-42a2-9d5e-fd2526003f2c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:44.302011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48858980-3321-42a2-9d5e-fd2526003f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:44.320143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-48858980-3321-42a2-9d5e-fd2526003f2c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:44.321362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-48858980-3321-42a2-9d5e-fd2526003f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:44.326417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522433-0b40-47c9-ab0a-c651448c73e2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:44.361414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8048c-d885-4f70-88d4-933ce8f4b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:44.362014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8048c-d885-4f70-88d4-933ce8f4b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:44.362286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8048c-d885-4f70-88d4-933ce8f4b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:44.362553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8048c-d885-4f70-88d4-933ce8f4b2f4 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:44.363272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8048c-d885-4f70-88d4-933ce8f4b2f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:44.363572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8048c-d885-4f70-88d4-933ce8f4b2f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:44.364985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8048c-d885-4f70-88d4-933ce8f4b2f4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:44.382946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 550/1093] 10.222.0.77 () {56 vars in 1133 bytes} [Wed Aug 10 22:42:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:44.388440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8048c-d885-4f70-88d4-933ce8f4b2f4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:44.389171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 544/1094] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:42:44.412390 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48858980-3321-42a2-9d5e-fd2526003f2c None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:44.429935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:44.460320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:44.490119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8048c-d885-4f70-88d4-933ce8f4b2f4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:44.510624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48858980-3321-42a2-9d5e-fd2526003f2c None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:44.523610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc8b2e-68c7-42f4-b5fb-cde49b37b846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:44.524205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc8b2e-68c7-42f4-b5fb-cde49b37b846 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:44.524489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc8b2e-68c7-42f4-b5fb-cde49b37b846 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:44.524754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc8b2e-68c7-42f4-b5fb-cde49b37b846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:44.544151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f10cd5-47c9-4ab4-ac03-156cf40e18fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:44.544779 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10cd5-47c9-4ab4-ac03-156cf40e18fc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:44.545052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10cd5-47c9-4ab4-ac03-156cf40e18fc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:44.545749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10cd5-47c9-4ab4-ac03-156cf40e18fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:44.557311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f10cd5-47c9-4ab4-ac03-156cf40e18fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-53f10cd5-47c9-4ab4-ac03-156cf40e18fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:42:44.561983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:44.563142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:42:44.564166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 545/1095] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:44.569565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f10cd5-47c9-4ab4-ac03-156cf40e18fc None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:44.594428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc8b2e-68c7-42f4-b5fb-cde49b37b846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:44.595866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc8b2e-68c7-42f4-b5fb-cde49b37b846 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:44.636629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:44.669433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f10cd5-47c9-4ab4-ac03-156cf40e18fc None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:44.679751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:44.698879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 551/1096] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 22:42:44.704533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc8b2e-68c7-42f4-b5fb-cde49b37b846 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:44.709833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28d7d2-e96d-41e6-bee3-931828d535ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:44.710396 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28d7d2-e96d-41e6-bee3-931828d535ba None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:44.710665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28d7d2-e96d-41e6-bee3-931828d535ba None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:44.710951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28d7d2-e96d-41e6-bee3-931828d535ba None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:44.711581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28d7d2-e96d-41e6-bee3-931828d535ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:44.712237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28d7d2-e96d-41e6-bee3-931828d535ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:44.713902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28d7d2-e96d-41e6-bee3-931828d535ba None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:44.727184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 546/1097] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:44.728339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28d7d2-e96d-41e6-bee3-931828d535ba None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:44.809686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc8b2e-68c7-42f4-b5fb-cde49b37b846 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:44.830670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28d7d2-e96d-41e6-bee3-931828d535ba None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:44.845009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef922bee-2b9d-4efc-8c49-9a57362cd077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:44.845734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef922bee-2b9d-4efc-8c49-9a57362cd077 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:44.846025 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef922bee-2b9d-4efc-8c49-9a57362cd077 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:44.846293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef922bee-2b9d-4efc-8c49-9a57362cd077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:44.854902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:44.856863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef922bee-2b9d-4efc-8c49-9a57362cd077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:44.858333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef922bee-2b9d-4efc-8c49-9a57362cd077 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:44.868220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d6e4f-74a9-4de9-bb2f-39e269eed8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:44.871083 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d6e4f-74a9-4de9-bb2f-39e269eed8d0 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:44.871083 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d6e4f-74a9-4de9-bb2f-39e269eed8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:44.871083 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d6e4f-74a9-4de9-bb2f-39e269eed8d0 None admin] PATH_INFO: `/v3/users/4dafe9582bf3449496f67eb46529ab54` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:44.871083 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d6e4f-74a9-4de9-bb2f-39e269eed8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=4dafe9582bf3449496f67eb46529ab54)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:44.871903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d6e4f-74a9-4de9-bb2f-39e269eed8d0 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ef922bee-2b9d-4efc-8c49-9a57362cd077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:42:44.873376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:44.878977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:42:44.880330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:42:44.880330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:42:44.880330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:44.880503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 547/1098] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:42:44 2022] GET /identity/v3/users/4dafe9582bf3449496f67eb46529ab54 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:44.880581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 552/1099] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:44.880651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d6e4f-74a9-4de9-bb2f-39e269eed8d0 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:44.880736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef922bee-2b9d-4efc-8c49-9a57362cd077 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:44.919796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:44.979059 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d6e4f-74a9-4de9-bb2f-39e269eed8d0 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:44.979284 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef922bee-2b9d-4efc-8c49-9a57362cd077 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:45.012754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d327c-10c0-4ee5-9119-3a4b20527a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:45.013391 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d327c-10c0-4ee5-9119-3a4b20527a1b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:45.013612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7417d-efbb-448f-82e0-e2613931b576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:45.013742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d327c-10c0-4ee5-9119-3a4b20527a1b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:45.013928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d327c-10c0-4ee5-9119-3a4b20527a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:45.014204 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7417d-efbb-448f-82e0-e2613931b576 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:45.014479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7417d-efbb-448f-82e0-e2613931b576 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:45.014747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7417d-efbb-448f-82e0-e2613931b576 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:45.015382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7417d-efbb-448f-82e0-e2613931b576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:45.015672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7417d-efbb-448f-82e0-e2613931b576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:45.017029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7417d-efbb-448f-82e0-e2613931b576 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:45.028431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 553/1100] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:45.034618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7417d-efbb-448f-82e0-e2613931b576 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:45.082519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d327c-10c0-4ee5-9119-3a4b20527a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:45.083937 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d327c-10c0-4ee5-9119-3a4b20527a1b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:45.086696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:45.121954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:45.133770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7417d-efbb-448f-82e0-e2613931b576 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:45.168651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db921a-ec9b-4bdb-b6f3-ce079bcfb77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:45.169270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db921a-ec9b-4bdb-b6f3-ce079bcfb77f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:45.169584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db921a-ec9b-4bdb-b6f3-ce079bcfb77f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:45.169920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db921a-ec9b-4bdb-b6f3-ce079bcfb77f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:45.177348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db921a-ec9b-4bdb-b6f3-ce079bcfb77f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:45.178835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db921a-ec9b-4bdb-b6f3-ce079bcfb77f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:45.182775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 548/1101] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:42:45.188581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d327c-10c0-4ee5-9119-3a4b20527a1b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-61db921a-ec9b-4bdb-b6f3-ce079bcfb77f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:42:45.190592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:42:45.191969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:42:45.193143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:42:45.193143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:42:45.193143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:42:45.193143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:42:45.193143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:42:45.193143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:42:45.193143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:42:45.193143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:42:45.193143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 554/1102] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 22:42:45.197570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db921a-ec9b-4bdb-b6f3-ce079bcfb77f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:45.299186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d327c-10c0-4ee5-9119-3a4b20527a1b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:45.305178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db921a-ec9b-4bdb-b6f3-ce079bcfb77f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:45.317996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:45.333316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ab7a8-a2bd-4e83-b753-9c607a7072b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:45.333949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ab7a8-a2bd-4e83-b753-9c607a7072b3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:45.334201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ab7a8-a2bd-4e83-b753-9c607a7072b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:45.334464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ab7a8-a2bd-4e83-b753-9c607a7072b3 None admin] PATH_INFO: `/v3/projects/feea915668784250b78e397240dc3e53` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:45.335553 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ab7a8-a2bd-4e83-b753-9c607a7072b3 None admin] RBAC: Authorizing `identity:get_project(project_id=feea915668784250b78e397240dc3e53)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:45.337006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ab7a8-a2bd-4e83-b753-9c607a7072b3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:45.338875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 549/1103] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:42:45 2022] GET /identity/v3/projects/feea915668784250b78e397240dc3e53 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:45.339281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc088-0855-4280-9bd5-b701f945b163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:45.339926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc088-0855-4280-9bd5-b701f945b163 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:45.340203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc088-0855-4280-9bd5-b701f945b163 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:45.340472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc088-0855-4280-9bd5-b701f945b163 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:45.341158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bc088-0855-4280-9bd5-b701f945b163 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:45.341480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bc088-0855-4280-9bd5-b701f945b163 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:45.342879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bc088-0855-4280-9bd5-b701f945b163 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:45.344617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ab7a8-a2bd-4e83-b753-9c607a7072b3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:45.354731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:45.360548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 555/1104] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:45.361917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc088-0855-4280-9bd5-b701f945b163 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:45.448002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ab7a8-a2bd-4e83-b753-9c607a7072b3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:45.460242 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc088-0855-4280-9bd5-b701f945b163 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:45.482352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c08c04-0af1-4e7b-9f4d-b5a48f128c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:45.482935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08c04-0af1-4e7b-9f4d-b5a48f128c57 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:45.483207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08c04-0af1-4e7b-9f4d-b5a48f128c57 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:45.483467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08c04-0af1-4e7b-9f4d-b5a48f128c57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:45.484181 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c08c04-0af1-4e7b-9f4d-b5a48f128c57 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=feea915668784250b78e397240dc3e53, user.id=4dafe9582bf3449496f67eb46529ab54) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:45.484477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c08c04-0af1-4e7b-9f4d-b5a48f128c57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:45.485933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c08c04-0af1-4e7b-9f4d-b5a48f128c57 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:45.491546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 550/1105] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:45 2022] GET /identity/v3/role_assignments?user.id=4dafe9582bf3449496f67eb46529ab54&scope.project.id=feea915668784250b78e397240dc3e53&role.id=edba0d8c079245a38a321d2d77d25419 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:45.495362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32254f-67cd-43ca-b93e-afaa1f103d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:45.495964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32254f-67cd-43ca-b93e-afaa1f103d98 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:45.496235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32254f-67cd-43ca-b93e-afaa1f103d98 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:45.496499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32254f-67cd-43ca-b93e-afaa1f103d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:45.497227 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32254f-67cd-43ca-b93e-afaa1f103d98 None admin] RBAC: Adding query filter params (role.id=0de4cd838d5c4fc1accf3463cffd2283, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=34568b830fc641edab39324047368546) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:45.497559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32254f-67cd-43ca-b93e-afaa1f103d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:45.499013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32254f-67cd-43ca-b93e-afaa1f103d98 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:45.517329 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 556/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:45 2022] GET /identity/v3/role_assignments?user.id=34568b830fc641edab39324047368546&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=0de4cd838d5c4fc1accf3463cffd2283 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:42:47.574723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883900f-9d51-411d-bb87-1ef095124476 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:47.575202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883900f-9d51-411d-bb87-1ef095124476 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:47.575312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883900f-9d51-411d-bb87-1ef095124476 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:47.576576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 551/1107] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:47.581905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eee83c-d5d6-4a19-a3ee-78488bd1a015 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:47.582324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eee83c-d5d6-4a19-a3ee-78488bd1a015 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:47.582423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eee83c-d5d6-4a19-a3ee-78488bd1a015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:47.600239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a5eee83c-d5d6-4a19-a3ee-78488bd1a015 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:47.601443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a5eee83c-d5d6-4a19-a3ee-78488bd1a015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:47.630422 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:47.667803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 557/1108] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:47.692982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883900f-9d51-411d-bb87-1ef095124476 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:47.762673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:47.798221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883900f-9d51-411d-bb87-1ef095124476 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:47.845848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a175b8f-3d6a-4961-afcf-3acfa2f7fe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:47.846404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175b8f-3d6a-4961-afcf-3acfa2f7fe93 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:47.846678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175b8f-3d6a-4961-afcf-3acfa2f7fe93 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:47.846946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175b8f-3d6a-4961-afcf-3acfa2f7fe93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:47.849421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175b8f-3d6a-4961-afcf-3acfa2f7fe93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:47.850623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175b8f-3d6a-4961-afcf-3acfa2f7fe93 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:47.852201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 552/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:47.857962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eee83c-d5d6-4a19-a3ee-78488bd1a015 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:47.953460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eee83c-d5d6-4a19-a3ee-78488bd1a015 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:47.985805 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8d6d9-e774-41d3-9f26-5f7a6da430e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:47.986396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8d6d9-e774-41d3-9f26-5f7a6da430e3 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:47.987247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8d6d9-e774-41d3-9f26-5f7a6da430e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:47.987511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8d6d9-e774-41d3-9f26-5f7a6da430e3 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:47.988138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8d6d9-e774-41d3-9f26-5f7a6da430e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:47.989563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8d6d9-e774-41d3-9f26-5f7a6da430e3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:48.089968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 558/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:42:47 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:42:50.132441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5217bb-567a-4f38-9ed1-8182705833bc None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:50.133006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5217bb-567a-4f38-9ed1-8182705833bc None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:50.133006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5217bb-567a-4f38-9ed1-8182705833bc None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:50.134326 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 553/1111] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:50.139500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fcf9b-a955-4c47-9b39-77f43bb0704d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:50.139916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fcf9b-a955-4c47-9b39-77f43bb0704d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:50.140047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fcf9b-a955-4c47-9b39-77f43bb0704d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:50.157708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-996fcf9b-a955-4c47-9b39-77f43bb0704d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:50.159492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-996fcf9b-a955-4c47-9b39-77f43bb0704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:50.176027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:50.224723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 559/1112] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:50.247803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5217bb-567a-4f38-9ed1-8182705833bc None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:50.346586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5217bb-567a-4f38-9ed1-8182705833bc None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:50.379768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0c297-99b3-43d5-965b-e3ae3b82f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:50.380382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0c297-99b3-43d5-965b-e3ae3b82f4b7 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:50.380655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0c297-99b3-43d5-965b-e3ae3b82f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:50.380933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0c297-99b3-43d5-965b-e3ae3b82f4b7 None admin] PATH_INFO: `/v3/roles/6654493feb544c46aeca606d309a1af2` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:50.382302 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0c297-99b3-43d5-965b-e3ae3b82f4b7 None admin] RBAC: Authorizing `identity:get_role(role_id=6654493feb544c46aeca606d309a1af2)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:50.383712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0c297-99b3-43d5-965b-e3ae3b82f4b7 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:50.384970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 554/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:42:50 2022] GET /identity/v3/roles/6654493feb544c46aeca606d309a1af2 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:50.390865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fcf9b-a955-4c47-9b39-77f43bb0704d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:50.488063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fcf9b-a955-4c47-9b39-77f43bb0704d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:50.521495 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ff2fe-9aee-4f52-93bd-2d2997919dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:50.522104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ff2fe-9aee-4f52-93bd-2d2997919dce None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:50.522380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ff2fe-9aee-4f52-93bd-2d2997919dce None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:50.522649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ff2fe-9aee-4f52-93bd-2d2997919dce None admin] PATH_INFO: `/v3/users/7044ab4b3c584ef1b0c3d30392e39608` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:50.535733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ff2fe-9aee-4f52-93bd-2d2997919dce None admin] RBAC: Authorizing `identity:get_user(user_id=7044ab4b3c584ef1b0c3d30392e39608)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:50.537155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ff2fe-9aee-4f52-93bd-2d2997919dce None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:50.538758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 560/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:42:50 2022] GET /identity/v3/users/7044ab4b3c584ef1b0c3d30392e39608 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:50.544568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0c297-99b3-43d5-965b-e3ae3b82f4b7 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:50.554577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:50.643240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0c297-99b3-43d5-965b-e3ae3b82f4b7 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:50.676344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb944b-aab5-4391-a073-b8046a27aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:50.676926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb944b-aab5-4391-a073-b8046a27aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:50.677199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb944b-aab5-4391-a073-b8046a27aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:50.677499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb944b-aab5-4391-a073-b8046a27aaa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:50.744275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb944b-aab5-4391-a073-b8046a27aaa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:50.745737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb944b-aab5-4391-a073-b8046a27aaa7 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:50.753160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:50.840796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 555/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:42:50.847435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ff2fe-9aee-4f52-93bd-2d2997919dce None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:50.859675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:50.944555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ff2fe-9aee-4f52-93bd-2d2997919dce None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:50.977140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205341b9-e191-41f3-a0ec-c01d018f66e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:50.977781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205341b9-e191-41f3-a0ec-c01d018f66e4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:50.978055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205341b9-e191-41f3-a0ec-c01d018f66e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:50.978321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205341b9-e191-41f3-a0ec-c01d018f66e4 None admin] PATH_INFO: `/v3/projects/feea915668784250b78e397240dc3e53` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:50.979401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205341b9-e191-41f3-a0ec-c01d018f66e4 None admin] RBAC: Authorizing `identity:get_project(project_id=feea915668784250b78e397240dc3e53)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:50.980803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205341b9-e191-41f3-a0ec-c01d018f66e4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:50.982424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 561/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:42:50 2022] GET /identity/v3/projects/feea915668784250b78e397240dc3e53 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:50.988796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb944b-aab5-4391-a073-b8046a27aaa7 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:51.083141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb944b-aab5-4391-a073-b8046a27aaa7 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:51.090112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:51.115250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62fc41-db65-45a0-8d80-4a022a7c6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:51.115834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62fc41-db65-45a0-8d80-4a022a7c6899 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:51.116102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62fc41-db65-45a0-8d80-4a022a7c6899 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:51.116364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62fc41-db65-45a0-8d80-4a022a7c6899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:51.117096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62fc41-db65-45a0-8d80-4a022a7c6899 None admin] RBAC: Adding query filter params (role.id=6654493feb544c46aeca606d309a1af2, scope.project.id=feea915668784250b78e397240dc3e53, user.id=7044ab4b3c584ef1b0c3d30392e39608) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:51.117440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62fc41-db65-45a0-8d80-4a022a7c6899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:51.119164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62fc41-db65-45a0-8d80-4a022a7c6899 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:51.124723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 556/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:50 2022] GET /identity/v3/role_assignments?user.id=7044ab4b3c584ef1b0c3d30392e39608&scope.project.id=feea915668784250b78e397240dc3e53&role.id=6654493feb544c46aeca606d309a1af2 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:53.087035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2ff44-1c58-4fb1-a39a-7feacc2cf0a4 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:53.087583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2ff44-1c58-4fb1-a39a-7feacc2cf0a4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:53.087583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2ff44-1c58-4fb1-a39a-7feacc2cf0a4 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:53.088886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 562/1118] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:42:53.094019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f480c4-4f5a-4df7-bbdb-2c8fb03f7f6d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:53.094421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f480c4-4f5a-4df7-bbdb-2c8fb03f7f6d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:53.094540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f480c4-4f5a-4df7-bbdb-2c8fb03f7f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:53.113002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-03f480c4-4f5a-4df7-bbdb-2c8fb03f7f6d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:53.114204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-03f480c4-4f5a-4df7-bbdb-2c8fb03f7f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:53.178349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 557/1119] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:53.200230 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2ff44-1c58-4fb1-a39a-7feacc2cf0a4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:53.276798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:53.298220 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2ff44-1c58-4fb1-a39a-7feacc2cf0a4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:53.331200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a9df-5604-4735-bbf0-c4541a164316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:53.331809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a9df-5604-4735-bbf0-c4541a164316 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:53.332082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a9df-5604-4735-bbf0-c4541a164316 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:53.332348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a9df-5604-4735-bbf0-c4541a164316 None admin] PATH_INFO: `/v3/roles/6654493feb544c46aeca606d309a1af2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:53.333743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9a9df-5604-4735-bbf0-c4541a164316 None admin] RBAC: Authorizing `identity:get_role(role_id=6654493feb544c46aeca606d309a1af2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:53.335089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9a9df-5604-4735-bbf0-c4541a164316 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:53.336403 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 563/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:42:53 2022] GET /identity/v3/roles/6654493feb544c46aeca606d309a1af2 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:53.342338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f480c4-4f5a-4df7-bbdb-2c8fb03f7f6d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:53.434718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:53.437600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f480c4-4f5a-4df7-bbdb-2c8fb03f7f6d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:53.469742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231de48-59ba-45b3-b9f5-6216974270c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:53.470348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231de48-59ba-45b3-b9f5-6216974270c7 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:53.471150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231de48-59ba-45b3-b9f5-6216974270c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:53.471410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231de48-59ba-45b3-b9f5-6216974270c7 None admin] PATH_INFO: `/v3/users/7044ab4b3c584ef1b0c3d30392e39608` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:53.472511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231de48-59ba-45b3-b9f5-6216974270c7 None admin] RBAC: Authorizing `identity:get_user(user_id=7044ab4b3c584ef1b0c3d30392e39608)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:53.474181 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231de48-59ba-45b3-b9f5-6216974270c7 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:53.475728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 558/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:42:53 2022] GET /identity/v3/users/7044ab4b3c584ef1b0c3d30392e39608 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:53.481833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a9df-5604-4735-bbf0-c4541a164316 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:53.578452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a9df-5604-4735-bbf0-c4541a164316 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:53.611945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138eaff-e8f4-4e20-a169-33ef92ecf590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:53.612510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138eaff-e8f4-4e20-a169-33ef92ecf590 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:53.612766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138eaff-e8f4-4e20-a169-33ef92ecf590 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:53.613030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138eaff-e8f4-4e20-a169-33ef92ecf590 None admin] PATH_INFO: `/v3/projects/feea915668784250b78e397240dc3e53` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:53.614145 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138eaff-e8f4-4e20-a169-33ef92ecf590 None admin] RBAC: Authorizing `identity:get_project(project_id=feea915668784250b78e397240dc3e53)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:53.615557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138eaff-e8f4-4e20-a169-33ef92ecf590 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:53.617141 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 564/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:42:53 2022] GET /identity/v3/projects/feea915668784250b78e397240dc3e53 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:53.623131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231de48-59ba-45b3-b9f5-6216974270c7 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:53.718453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231de48-59ba-45b3-b9f5-6216974270c7 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:53.751241 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e6379-bef2-42e9-8564-870790eb0166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:53.751895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e6379-bef2-42e9-8564-870790eb0166 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:53.752165 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e6379-bef2-42e9-8564-870790eb0166 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:53.752428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e6379-bef2-42e9-8564-870790eb0166 None admin] PATH_INFO: `/v3/projects/feea915668784250b78e397240dc3e53/users/7044ab4b3c584ef1b0c3d30392e39608/roles/6654493feb544c46aeca606d309a1af2` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:53.754512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e6379-bef2-42e9-8564-870790eb0166 None admin] RBAC: Authorizing `identity:create_grant(project_id=feea915668784250b78e397240dc3e53, user_id=7044ab4b3c584ef1b0c3d30392e39608, role_id=6654493feb544c46aeca606d309a1af2)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:53.755907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e6379-bef2-42e9-8564-870790eb0166 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:53.826679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 559/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:42:53 2022] PUT /identity/v3/projects/feea915668784250b78e397240dc3e53/users/7044ab4b3c584ef1b0c3d30392e39608/roles/6654493feb544c46aeca606d309a1af2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:42:55.801231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028240-8b0b-4776-9ab2-0a3185b4c2b9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:55.801775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028240-8b0b-4776-9ab2-0a3185b4c2b9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:55.801775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028240-8b0b-4776-9ab2-0a3185b4c2b9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:55.803019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 565/1124] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:55.808193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a52247-e3af-475e-b1b9-b7607ca0bd0b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:55.808633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a52247-e3af-475e-b1b9-b7607ca0bd0b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:55.808743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a52247-e3af-475e-b1b9-b7607ca0bd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:55.826929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-64a52247-e3af-475e-b1b9-b7607ca0bd0b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:55.828167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-64a52247-e3af-475e-b1b9-b7607ca0bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:55.850423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:55.894446 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 560/1125] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:55.918158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21028240-8b0b-4776-9ab2-0a3185b4c2b9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:55.935007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:56.020297 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21028240-8b0b-4776-9ab2-0a3185b4c2b9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:56.053981 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afeccc-269a-4211-9154-3a2fbeb4eb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:56.054564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afeccc-269a-4211-9154-3a2fbeb4eb0d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:56.054838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afeccc-269a-4211-9154-3a2fbeb4eb0d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:56.055105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afeccc-269a-4211-9154-3a2fbeb4eb0d None admin] PATH_INFO: `/v3/roles/6654493feb544c46aeca606d309a1af2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:56.056474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afeccc-269a-4211-9154-3a2fbeb4eb0d None admin] RBAC: Authorizing `identity:get_role(role_id=6654493feb544c46aeca606d309a1af2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:56.057865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afeccc-269a-4211-9154-3a2fbeb4eb0d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:56.059181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 566/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:42:55 2022] GET /identity/v3/roles/6654493feb544c46aeca606d309a1af2 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:56.065694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a52247-e3af-475e-b1b9-b7607ca0bd0b None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:56.160812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a52247-e3af-475e-b1b9-b7607ca0bd0b None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:56.193761 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea885-b770-452d-820a-b0081f5c34a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:56.194399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea885-b770-452d-820a-b0081f5c34a4 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:56.194676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea885-b770-452d-820a-b0081f5c34a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:56.194948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea885-b770-452d-820a-b0081f5c34a4 None admin] PATH_INFO: `/v3/users/7044ab4b3c584ef1b0c3d30392e39608` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:56.196085 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea885-b770-452d-820a-b0081f5c34a4 None admin] RBAC: Authorizing `identity:get_user(user_id=7044ab4b3c584ef1b0c3d30392e39608)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:56.197542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea885-b770-452d-820a-b0081f5c34a4 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:56.199142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 561/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:42:56 2022] GET /identity/v3/users/7044ab4b3c584ef1b0c3d30392e39608 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:56.205894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afeccc-269a-4211-9154-3a2fbeb4eb0d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:56.288335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:56.306181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afeccc-269a-4211-9154-3a2fbeb4eb0d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:56.337979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122444-2192-443d-98f8-4e324008b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:56.338566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122444-2192-443d-98f8-4e324008b677 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:56.338837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122444-2192-443d-98f8-4e324008b677 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:56.339098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122444-2192-443d-98f8-4e324008b677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:56.403226 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2122444-2192-443d-98f8-4e324008b677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:56.404648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2122444-2192-443d-98f8-4e324008b677 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:56.480363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:56.502033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 567/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:42:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:42:56.507480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea885-b770-452d-820a-b0081f5c34a4 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:56.537842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:56.610161 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea885-b770-452d-820a-b0081f5c34a4 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:56.642152 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0314f-8830-4085-9799-c3093e0c7532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:56.643304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0314f-8830-4085-9799-c3093e0c7532 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:56.643581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0314f-8830-4085-9799-c3093e0c7532 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:56.643853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0314f-8830-4085-9799-c3093e0c7532 None admin] PATH_INFO: `/v3/projects/feea915668784250b78e397240dc3e53` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:56.644958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0314f-8830-4085-9799-c3093e0c7532 None admin] RBAC: Authorizing `identity:get_project(project_id=feea915668784250b78e397240dc3e53)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:56.646401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0314f-8830-4085-9799-c3093e0c7532 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:56.648020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 562/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:42:56 2022] GET /identity/v3/projects/feea915668784250b78e397240dc3e53 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:56.654444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122444-2192-443d-98f8-4e324008b677 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:56.759517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122444-2192-443d-98f8-4e324008b677 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:56.796430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfff8fd-201b-4a4e-b6fa-26712fd96881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:56.797031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff8fd-201b-4a4e-b6fa-26712fd96881 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:56.797317 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff8fd-201b-4a4e-b6fa-26712fd96881 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:56.797595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfff8fd-201b-4a4e-b6fa-26712fd96881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:56.798317 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfff8fd-201b-4a4e-b6fa-26712fd96881 None admin] RBAC: Adding query filter params (role.id=6654493feb544c46aeca606d309a1af2, scope.project.id=feea915668784250b78e397240dc3e53, user.id=7044ab4b3c584ef1b0c3d30392e39608) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:42:56.798615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfff8fd-201b-4a4e-b6fa-26712fd96881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:56.800032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfff8fd-201b-4a4e-b6fa-26712fd96881 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:56.806295 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 568/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:42:56 2022] GET /identity/v3/role_assignments?user.id=7044ab4b3c584ef1b0c3d30392e39608&scope.project.id=feea915668784250b78e397240dc3e53&role.id=6654493feb544c46aeca606d309a1af2 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:58.826599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f81a28-3fa2-4a7c-9459-277ae8bdb8ad None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:58.827116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f81a28-3fa2-4a7c-9459-277ae8bdb8ad None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:58.827116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f81a28-3fa2-4a7c-9459-277ae8bdb8ad None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:58.828430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 563/1131] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:42:58.833655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0f20d-3f69-4d04-9add-8d2db8593bfe None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:58.834076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0f20d-3f69-4d04-9add-8d2db8593bfe None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:58.834199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0f20d-3f69-4d04-9add-8d2db8593bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:58.852234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5bf0f20d-3f69-4d04-9add-8d2db8593bfe None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:42:58.853465 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5bf0f20d-3f69-4d04-9add-8d2db8593bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:42:58.894790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:58.918175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 569/1132] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:42:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:42:58.941743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f81a28-3fa2-4a7c-9459-277ae8bdb8ad None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:59.031857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:42:59.039212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f81a28-3fa2-4a7c-9459-277ae8bdb8ad None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:59.071808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68f55-8aab-4725-8df7-7f3eb89da984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:59.072415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68f55-8aab-4725-8df7-7f3eb89da984 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:59.072686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68f55-8aab-4725-8df7-7f3eb89da984 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:59.072950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68f55-8aab-4725-8df7-7f3eb89da984 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:59.074066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68f55-8aab-4725-8df7-7f3eb89da984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:59.075472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68f55-8aab-4725-8df7-7f3eb89da984 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:59.077126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 564/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:42:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:42:59.083040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0f20d-3f69-4d04-9add-8d2db8593bfe None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:42:59.179456 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0f20d-3f69-4d04-9add-8d2db8593bfe None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:42:59.211784 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecac06-580a-44d7-a252-042f725c250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:42:59.212379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecac06-580a-44d7-a252-042f725c250e None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:42:59.212650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecac06-580a-44d7-a252-042f725c250e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:42:59.212917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecac06-580a-44d7-a252-042f725c250e None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:42:59.213583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecac06-580a-44d7-a252-042f725c250e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:42:59.215002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecac06-580a-44d7-a252-042f725c250e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:42:59.324601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 570/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:42:59 2022] POST /identity/v3/projects => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:43:01.344536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200ce2c-51fd-4eda-ab5c-67bb98aad633 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:01.345065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200ce2c-51fd-4eda-ab5c-67bb98aad633 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:01.345065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200ce2c-51fd-4eda-ab5c-67bb98aad633 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:01.346471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 565/1135] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:01.352455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a9bcd-b3f7-4e0c-af11-12130bdcce04 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:01.352840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a9bcd-b3f7-4e0c-af11-12130bdcce04 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:01.353002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a9bcd-b3f7-4e0c-af11-12130bdcce04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:01.370854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-294a9bcd-b3f7-4e0c-af11-12130bdcce04 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:01.372025 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-294a9bcd-b3f7-4e0c-af11-12130bdcce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:01.395768 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:01.437936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 571/1136] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:43:01.463119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200ce2c-51fd-4eda-ab5c-67bb98aad633 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:01.562433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200ce2c-51fd-4eda-ab5c-67bb98aad633 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:01.595605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da118d74-dda2-4f97-80c7-c5d5bee58268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:01.596227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da118d74-dda2-4f97-80c7-c5d5bee58268 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:01.596502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da118d74-dda2-4f97-80c7-c5d5bee58268 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:01.596765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da118d74-dda2-4f97-80c7-c5d5bee58268 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:01.597863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da118d74-dda2-4f97-80c7-c5d5bee58268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:01.599519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da118d74-dda2-4f97-80c7-c5d5bee58268 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:01.601050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 566/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:43:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:01.606821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a9bcd-b3f7-4e0c-af11-12130bdcce04 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:01.703025 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a9bcd-b3f7-4e0c-af11-12130bdcce04 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:01.737553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df70b23-2633-4bd2-9690-f67c8403c636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:01.738134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df70b23-2633-4bd2-9690-f67c8403c636 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:01.738406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df70b23-2633-4bd2-9690-f67c8403c636 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:01.738669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df70b23-2633-4bd2-9690-f67c8403c636 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:01.739305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df70b23-2633-4bd2-9690-f67c8403c636 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:01.740721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df70b23-2633-4bd2-9690-f67c8403c636 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:01.829631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 572/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:43:01 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:43:03.849968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705e09e-536d-453b-9aa9-97c645174d54 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:03.850468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705e09e-536d-453b-9aa9-97c645174d54 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:03.850468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705e09e-536d-453b-9aa9-97c645174d54 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:03.851735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 567/1139] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:03.856780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec643ce-201b-48a6-a52d-c6b6f73ffb0a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:03.857147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec643ce-201b-48a6-a52d-c6b6f73ffb0a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:03.857337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec643ce-201b-48a6-a52d-c6b6f73ffb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:03.875370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-eec643ce-201b-48a6-a52d-c6b6f73ffb0a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:03.876528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eec643ce-201b-48a6-a52d-c6b6f73ffb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:03.885496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:03.941899 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 573/1140] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:43:03.964398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705e09e-536d-453b-9aa9-97c645174d54 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:03.994883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:04.063160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705e09e-536d-453b-9aa9-97c645174d54 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:04.096015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c92b-4f53-4591-ab65-05962b206011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:04.096622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c92b-4f53-4591-ab65-05962b206011 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:04.096895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c92b-4f53-4591-ab65-05962b206011 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:04.097160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c92b-4f53-4591-ab65-05962b206011 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:04.107186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8c92b-4f53-4591-ab65-05962b206011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5fa8c92b-4f53-4591-ab65-05962b206011 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:43:04.111772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:43:04.112902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:43:04.114164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 568/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:43:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:43:04.119143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec643ce-201b-48a6-a52d-c6b6f73ffb0a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:04.214309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec643ce-201b-48a6-a52d-c6b6f73ffb0a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:04.246869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe55fd-142b-40a5-991f-07045b05ed8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:04.247456 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe55fd-142b-40a5-991f-07045b05ed8f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:04.247725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe55fd-142b-40a5-991f-07045b05ed8f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:04.247988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe55fd-142b-40a5-991f-07045b05ed8f None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:04.248637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe55fd-142b-40a5-991f-07045b05ed8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:04.248930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe55fd-142b-40a5-991f-07045b05ed8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:04.250306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe55fd-142b-40a5-991f-07045b05ed8f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:04.258021 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 574/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:43:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:04.263788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c92b-4f53-4591-ab65-05962b206011 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:04.354068 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:04.363151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c92b-4f53-4591-ab65-05962b206011 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:04.395882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c1382-29d7-4ae9-9f84-251522a90009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:04.396487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1382-29d7-4ae9-9f84-251522a90009 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:04.396759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1382-29d7-4ae9-9f84-251522a90009 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:04.397027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1382-29d7-4ae9-9f84-251522a90009 None admin] PATH_INFO: `/v3/users/658e13503def4d6a8cb611a4d98079b4` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:04.409440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c1382-29d7-4ae9-9f84-251522a90009 None admin] RBAC: Authorizing `identity:get_user(user_id=658e13503def4d6a8cb611a4d98079b4)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:04.410846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c1382-29d7-4ae9-9f84-251522a90009 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:04.412423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 569/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:43:04 2022] GET /identity/v3/users/658e13503def4d6a8cb611a4d98079b4 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:04.418373 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe55fd-142b-40a5-991f-07045b05ed8f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:04.427359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:04.516246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe55fd-142b-40a5-991f-07045b05ed8f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:04.549893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae3840-2c38-485d-b605-53a4d64a7a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:04.550438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3840-2c38-485d-b605-53a4d64a7a29 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:04.550737 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3840-2c38-485d-b605-53a4d64a7a29 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:04.551003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3840-2c38-485d-b605-53a4d64a7a29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:04.617392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae3840-2c38-485d-b605-53a4d64a7a29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:04.618735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae3840-2c38-485d-b605-53a4d64a7a29 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:04.626004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:04.713572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 575/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:43:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:43:04.719332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c1382-29d7-4ae9-9f84-251522a90009 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:04.820273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c1382-29d7-4ae9-9f84-251522a90009 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:04.853007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7845-1121-4182-bc8d-e90a0b8edfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:04.853661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7845-1121-4182-bc8d-e90a0b8edfad None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:04.853902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7845-1121-4182-bc8d-e90a0b8edfad None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:04.854166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7845-1121-4182-bc8d-e90a0b8edfad None admin] PATH_INFO: `/v3/projects/c253d006ecfc4ed99e14f49c10168aef` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:04.855252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7845-1121-4182-bc8d-e90a0b8edfad None admin] RBAC: Authorizing `identity:get_project(project_id=c253d006ecfc4ed99e14f49c10168aef)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:04.856650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7845-1121-4182-bc8d-e90a0b8edfad None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:04.858282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 570/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:43:04 2022] GET /identity/v3/projects/c253d006ecfc4ed99e14f49c10168aef => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:04.864960 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae3840-2c38-485d-b605-53a4d64a7a29 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:04.960930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae3840-2c38-485d-b605-53a4d64a7a29 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:04.967907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:04.994497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58959030-6fe7-49f2-a116-8baffbbb5885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:04.995089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959030-6fe7-49f2-a116-8baffbbb5885 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:04.995365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959030-6fe7-49f2-a116-8baffbbb5885 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:04.995635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58959030-6fe7-49f2-a116-8baffbbb5885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:04.996346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58959030-6fe7-49f2-a116-8baffbbb5885 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=c253d006ecfc4ed99e14f49c10168aef, user.id=658e13503def4d6a8cb611a4d98079b4) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:04.996648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58959030-6fe7-49f2-a116-8baffbbb5885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:04.998091 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58959030-6fe7-49f2-a116-8baffbbb5885 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:05.004036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 576/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:43:04 2022] GET /identity/v3/role_assignments?user.id=658e13503def4d6a8cb611a4d98079b4&scope.project.id=c253d006ecfc4ed99e14f49c10168aef&role.id=edba0d8c079245a38a321d2d77d25419 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:06.967333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3e645-9b60-4d1c-af34-c7e6871dba49 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:06.967835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3e645-9b60-4d1c-af34-c7e6871dba49 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:06.967835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3e645-9b60-4d1c-af34-c7e6871dba49 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:06.969112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 571/1147] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:06.974990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcca16-d639-4ffe-873d-b794e9003237 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:06.975429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcca16-d639-4ffe-873d-b794e9003237 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:06.975532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcca16-d639-4ffe-873d-b794e9003237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:06.994376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-acfcca16-d639-4ffe-873d-b794e9003237 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:06.995531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-acfcca16-d639-4ffe-873d-b794e9003237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:07.059171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 577/1148] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:43:07.081804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3e645-9b60-4d1c-af34-c7e6871dba49 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:07.100435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:07.181707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3e645-9b60-4d1c-af34-c7e6871dba49 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:07.214527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476111-7692-484c-bf27-9ee922d11803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:07.215137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476111-7692-484c-bf27-9ee922d11803 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:07.215412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476111-7692-484c-bf27-9ee922d11803 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:07.215682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476111-7692-484c-bf27-9ee922d11803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:07.231494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476111-7692-484c-bf27-9ee922d11803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-18476111-7692-484c-bf27-9ee922d11803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:43:07.236334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:43:07.237467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:43:07.238322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 572/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:43:07.243565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcca16-d639-4ffe-873d-b794e9003237 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:07.335187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:07.338081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcca16-d639-4ffe-873d-b794e9003237 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:07.371159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bbbf7-6e57-4b57-9744-af9345181915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:07.371751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bbbf7-6e57-4b57-9744-af9345181915 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:07.372024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bbbf7-6e57-4b57-9744-af9345181915 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:07.372292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bbbf7-6e57-4b57-9744-af9345181915 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:07.372943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bbbf7-6e57-4b57-9744-af9345181915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:07.373239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bbbf7-6e57-4b57-9744-af9345181915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:07.374618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bbbf7-6e57-4b57-9744-af9345181915 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:07.383562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 578/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:07.389556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476111-7692-484c-bf27-9ee922d11803 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:07.465204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:07.487170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476111-7692-484c-bf27-9ee922d11803 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:07.520187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8988d43-6a98-4b0b-ad3c-9158c38fa2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:07.521205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8988d43-6a98-4b0b-ad3c-9158c38fa2e2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:07.521205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8988d43-6a98-4b0b-ad3c-9158c38fa2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:07.521419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8988d43-6a98-4b0b-ad3c-9158c38fa2e2 None admin] PATH_INFO: `/v3/users/658e13503def4d6a8cb611a4d98079b4` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:07.522445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8988d43-6a98-4b0b-ad3c-9158c38fa2e2 None admin] RBAC: Authorizing `identity:get_user(user_id=658e13503def4d6a8cb611a4d98079b4)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:07.523850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8988d43-6a98-4b0b-ad3c-9158c38fa2e2 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:07.525426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 573/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:43:07 2022] GET /identity/v3/users/658e13503def4d6a8cb611a4d98079b4 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:07.531214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bbbf7-6e57-4b57-9744-af9345181915 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:07.631424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bbbf7-6e57-4b57-9744-af9345181915 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:07.664165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372eeea-e6e8-4bb2-b81e-35e0a9ca0f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:07.664782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372eeea-e6e8-4bb2-b81e-35e0a9ca0f12 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:07.665060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372eeea-e6e8-4bb2-b81e-35e0a9ca0f12 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:07.665361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372eeea-e6e8-4bb2-b81e-35e0a9ca0f12 None admin] PATH_INFO: `/v3/projects/c253d006ecfc4ed99e14f49c10168aef` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:07.666470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372eeea-e6e8-4bb2-b81e-35e0a9ca0f12 None admin] RBAC: Authorizing `identity:get_project(project_id=c253d006ecfc4ed99e14f49c10168aef)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:07.667889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372eeea-e6e8-4bb2-b81e-35e0a9ca0f12 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:07.669544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 579/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:43:07 2022] GET /identity/v3/projects/c253d006ecfc4ed99e14f49c10168aef => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:07.675527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8988d43-6a98-4b0b-ad3c-9158c38fa2e2 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:07.777525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8988d43-6a98-4b0b-ad3c-9158c38fa2e2 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:07.810602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a6df2-fdb1-4346-8722-bb251f087715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:07.811247 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a6df2-fdb1-4346-8722-bb251f087715 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:07.811523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a6df2-fdb1-4346-8722-bb251f087715 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:07.811789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a6df2-fdb1-4346-8722-bb251f087715 None admin] PATH_INFO: `/v3/projects/c253d006ecfc4ed99e14f49c10168aef/users/658e13503def4d6a8cb611a4d98079b4/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:07.813749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a6df2-fdb1-4346-8722-bb251f087715 None admin] RBAC: Authorizing `identity:create_grant(project_id=c253d006ecfc4ed99e14f49c10168aef, user_id=658e13503def4d6a8cb611a4d98079b4, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:07.815156 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a6df2-fdb1-4346-8722-bb251f087715 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:07.935008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 574/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:43:07 2022] PUT /identity/v3/projects/c253d006ecfc4ed99e14f49c10168aef/users/658e13503def4d6a8cb611a4d98079b4/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:43:09.980398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fdda-bdc8-466e-8db5-c19f9e37f6cc None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:09.981015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fdda-bdc8-466e-8db5-c19f9e37f6cc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:09.981015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fdda-bdc8-466e-8db5-c19f9e37f6cc None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:09.982297 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 580/1154] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:09.988037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe9c1-7f5a-4701-b9e9-982bc60ff583 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:09.988491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe9c1-7f5a-4701-b9e9-982bc60ff583 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:09.988592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe9c1-7f5a-4701-b9e9-982bc60ff583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:09.995661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:10.007051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e0bbe9c1-7f5a-4701-b9e9-982bc60ff583 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:10.012509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e0bbe9c1-7f5a-4701-b9e9-982bc60ff583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:10.073210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 575/1155] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:43:10.096413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6fdda-bdc8-466e-8db5-c19f9e37f6cc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:10.131543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:10.206486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6fdda-bdc8-466e-8db5-c19f9e37f6cc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:10.242102 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303520e-af4c-4b7b-b7d0-76359beaf34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:10.242989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303520e-af4c-4b7b-b7d0-76359beaf34a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:10.243420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303520e-af4c-4b7b-b7d0-76359beaf34a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:10.243857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303520e-af4c-4b7b-b7d0-76359beaf34a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:10.255839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303520e-af4c-4b7b-b7d0-76359beaf34a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-b303520e-af4c-4b7b-b7d0-76359beaf34a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:43:10.260518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:43:10.261733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:43:10.262779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 581/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:43:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:43:10.268119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbe9c1-7f5a-4701-b9e9-982bc60ff583 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:10.374413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbe9c1-7f5a-4701-b9e9-982bc60ff583 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:10.411034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b2f16-f85a-40f7-894f-45ab2e0cd950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:10.411650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b2f16-f85a-40f7-894f-45ab2e0cd950 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:10.411970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b2f16-f85a-40f7-894f-45ab2e0cd950 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:10.412242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b2f16-f85a-40f7-894f-45ab2e0cd950 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:10.412913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b2f16-f85a-40f7-894f-45ab2e0cd950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:10.413215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b2f16-f85a-40f7-894f-45ab2e0cd950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:10.414650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b2f16-f85a-40f7-894f-45ab2e0cd950 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:10.416296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:10.424519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 576/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:10.430443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303520e-af4c-4b7b-b7d0-76359beaf34a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:10.526714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:10.536725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303520e-af4c-4b7b-b7d0-76359beaf34a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:10.573057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1df79f-0247-46c5-98d5-ecdf71da27a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:10.573712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1df79f-0247-46c5-98d5-ecdf71da27a7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:10.573989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1df79f-0247-46c5-98d5-ecdf71da27a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:10.574263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1df79f-0247-46c5-98d5-ecdf71da27a7 None admin] PATH_INFO: `/v3/users/658e13503def4d6a8cb611a4d98079b4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:10.575391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1df79f-0247-46c5-98d5-ecdf71da27a7 None admin] RBAC: Authorizing `identity:get_user(user_id=658e13503def4d6a8cb611a4d98079b4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:10.576827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1df79f-0247-46c5-98d5-ecdf71da27a7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:10.578439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 582/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:43:10 2022] GET /identity/v3/users/658e13503def4d6a8cb611a4d98079b4 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:10.586088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b2f16-f85a-40f7-894f-45ab2e0cd950 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:10.697627 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b2f16-f85a-40f7-894f-45ab2e0cd950 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:10.737375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f0e64-4b9a-4f9d-82d9-6472f211b6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:10.738020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f0e64-4b9a-4f9d-82d9-6472f211b6e6 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:10.738250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f0e64-4b9a-4f9d-82d9-6472f211b6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:10.738505 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f0e64-4b9a-4f9d-82d9-6472f211b6e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:10.805745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:10.812104 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f0e64-4b9a-4f9d-82d9-6472f211b6e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:10.815809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f0e64-4b9a-4f9d-82d9-6472f211b6e6 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:10.928191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 577/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:43:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:43:10.934145 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1df79f-0247-46c5-98d5-ecdf71da27a7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:11.038007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1df79f-0247-46c5-98d5-ecdf71da27a7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:11.070024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdf313-8a83-4c35-bf27-4466e6e9f8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:11.070568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdf313-8a83-4c35-bf27-4466e6e9f8d7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:11.070846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdf313-8a83-4c35-bf27-4466e6e9f8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:11.071115 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdf313-8a83-4c35-bf27-4466e6e9f8d7 None admin] PATH_INFO: `/v3/projects/c253d006ecfc4ed99e14f49c10168aef` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:11.072219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdf313-8a83-4c35-bf27-4466e6e9f8d7 None admin] RBAC: Authorizing `identity:get_project(project_id=c253d006ecfc4ed99e14f49c10168aef)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:11.073669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdf313-8a83-4c35-bf27-4466e6e9f8d7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:11.075279 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 583/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:43:10 2022] GET /identity/v3/projects/c253d006ecfc4ed99e14f49c10168aef => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:11.082044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f0e64-4b9a-4f9d-82d9-6472f211b6e6 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:11.174655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:11.180251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f0e64-4b9a-4f9d-82d9-6472f211b6e6 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:11.214031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f9843-4554-41d7-989c-0bd17fc31b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:11.214749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f9843-4554-41d7-989c-0bd17fc31b34 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:11.215022 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f9843-4554-41d7-989c-0bd17fc31b34 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:11.215288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f9843-4554-41d7-989c-0bd17fc31b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:11.216000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f9843-4554-41d7-989c-0bd17fc31b34 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=c253d006ecfc4ed99e14f49c10168aef, user.id=658e13503def4d6a8cb611a4d98079b4) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:11.216299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f9843-4554-41d7-989c-0bd17fc31b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:11.217764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f9843-4554-41d7-989c-0bd17fc31b34 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:11.224033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 578/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:43:11 2022] GET /identity/v3/role_assignments?user.id=658e13503def4d6a8cb611a4d98079b4&scope.project.id=c253d006ecfc4ed99e14f49c10168aef&role.id=edba0d8c079245a38a321d2d77d25419 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:13.336961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc363bd9-8a54-4f9f-b60c-c7077f786f29 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:13.337537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc363bd9-8a54-4f9f-b60c-c7077f786f29 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:13.337537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc363bd9-8a54-4f9f-b60c-c7077f786f29 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:13.338830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 584/1162] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:13.344093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441f351-7e10-42d3-aa10-9aaea6b8239a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:13.344552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441f351-7e10-42d3-aa10-9aaea6b8239a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:13.344666 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441f351-7e10-42d3-aa10-9aaea6b8239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:13.363896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-5441f351-7e10-42d3-aa10-9aaea6b8239a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:13.365079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5441f351-7e10-42d3-aa10-9aaea6b8239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:13.431890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 579/1163] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:43:13.453762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc363bd9-8a54-4f9f-b60c-c7077f786f29 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:13.481504 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:13.554939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc363bd9-8a54-4f9f-b60c-c7077f786f29 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:13.589593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f2ca-6e1c-49d0-89a7-c9abb04dcf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:13.590108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f2ca-6e1c-49d0-89a7-c9abb04dcf9d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:13.590381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f2ca-6e1c-49d0-89a7-c9abb04dcf9d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:13.590649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f2ca-6e1c-49d0-89a7-c9abb04dcf9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:13.658319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f2ca-6e1c-49d0-89a7-c9abb04dcf9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:13.659761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f2ca-6e1c-49d0-89a7-c9abb04dcf9d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:13.686365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:13.758323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 585/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:43:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:43:13.764419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441f351-7e10-42d3-aa10-9aaea6b8239a None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:13.853559 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:13.862793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441f351-7e10-42d3-aa10-9aaea6b8239a None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:13.904823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523353cb-7be4-4d1c-b3e8-3cc50f8e857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:13.905463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523353cb-7be4-4d1c-b3e8-3cc50f8e857d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:13.905733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523353cb-7be4-4d1c-b3e8-3cc50f8e857d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:13.906004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523353cb-7be4-4d1c-b3e8-3cc50f8e857d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:13.915342 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523353cb-7be4-4d1c-b3e8-3cc50f8e857d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:13.916775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523353cb-7be4-4d1c-b3e8-3cc50f8e857d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-523353cb-7be4-4d1c-b3e8-3cc50f8e857d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:43:13.932425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:43:13.933686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:43:13.934581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 580/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Aug 10 22:43:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:43:13.939611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f2ca-6e1c-49d0-89a7-c9abb04dcf9d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:14.035394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f2ca-6e1c-49d0-89a7-c9abb04dcf9d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:14.060241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:14.069354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353516a-71a7-435f-a2fa-1ee65319e84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:14.069949 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353516a-71a7-435f-a2fa-1ee65319e84b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:14.070222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353516a-71a7-435f-a2fa-1ee65319e84b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:14.070487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353516a-71a7-435f-a2fa-1ee65319e84b None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:14.071117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353516a-71a7-435f-a2fa-1ee65319e84b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:14.071412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353516a-71a7-435f-a2fa-1ee65319e84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:14.072759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353516a-71a7-435f-a2fa-1ee65319e84b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:14.079642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 586/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Wed Aug 10 22:43:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:16.054134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290517a-0b9e-4296-8ed0-edef4a717410 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:16.054664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290517a-0b9e-4296-8ed0-edef4a717410 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:16.054664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290517a-0b9e-4296-8ed0-edef4a717410 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:16.055983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 581/1167] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:16.061249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745d0b6-43bc-463d-8013-d555ec0236c1 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:16.061715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745d0b6-43bc-463d-8013-d555ec0236c1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:16.061824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745d0b6-43bc-463d-8013-d555ec0236c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:16.080556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5745d0b6-43bc-463d-8013-d555ec0236c1 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:16.081789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5745d0b6-43bc-463d-8013-d555ec0236c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:16.151061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 587/1168] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:43:16.174271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290517a-0b9e-4296-8ed0-edef4a717410 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:16.276150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290517a-0b9e-4296-8ed0-edef4a717410 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:16.310763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fab4d-db73-4168-a51b-8497426ed82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:16.311279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fab4d-db73-4168-a51b-8497426ed82b None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:16.311551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fab4d-db73-4168-a51b-8497426ed82b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:16.311816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fab4d-db73-4168-a51b-8497426ed82b None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:16.312463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fab4d-db73-4168-a51b-8497426ed82b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:16.313891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fab4d-db73-4168-a51b-8497426ed82b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:16.410990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 582/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Wed Aug 10 22:43:16 2022] POST /identity/v3/domains => generated 267 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:43:18.441823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57cbc8-e0e1-43b3-a31b-ed86e6d9f45f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:18.442378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57cbc8-e0e1-43b3-a31b-ed86e6d9f45f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:18.442378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57cbc8-e0e1-43b3-a31b-ed86e6d9f45f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:18.443671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 588/1170] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:18.448916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035447d8-54b4-47f2-86a2-c66477f20515 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:18.449376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035447d8-54b4-47f2-86a2-c66477f20515 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:18.449478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035447d8-54b4-47f2-86a2-c66477f20515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:18.467514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-035447d8-54b4-47f2-86a2-c66477f20515 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:18.468677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-035447d8-54b4-47f2-86a2-c66477f20515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:18.472038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:18.534835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 583/1171] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:43:18.558199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57cbc8-e0e1-43b3-a31b-ed86e6d9f45f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:18.658081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57cbc8-e0e1-43b3-a31b-ed86e6d9f45f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:18.678622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:18.695668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce6754-d4ab-4e49-950d-a93c1a26d154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:18.695668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce6754-d4ab-4e49-950d-a93c1a26d154 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:18.695668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce6754-d4ab-4e49-950d-a93c1a26d154 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:18.695668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce6754-d4ab-4e49-950d-a93c1a26d154 None admin] PATH_INFO: `/v3/domains/896e4baae68142a99e572c7a0150d385` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:18.705060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce6754-d4ab-4e49-950d-a93c1a26d154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=896e4baae68142a99e572c7a0150d385)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:18.706526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce6754-d4ab-4e49-950d-a93c1a26d154 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:18.708275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 589/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Wed Aug 10 22:43:18 2022] GET /identity/v3/domains/896e4baae68142a99e572c7a0150d385 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:18.714239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035447d8-54b4-47f2-86a2-c66477f20515 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:18.809386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035447d8-54b4-47f2-86a2-c66477f20515 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:18.842118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf7d4e-aadb-4860-ad06-9a7471a3c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:18.842706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf7d4e-aadb-4860-ad06-9a7471a3c566 None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:18.842976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf7d4e-aadb-4860-ad06-9a7471a3c566 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:18.843239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf7d4e-aadb-4860-ad06-9a7471a3c566 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:18.843870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf7d4e-aadb-4860-ad06-9a7471a3c566 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:18.845355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf7d4e-aadb-4860-ad06-9a7471a3c566 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:18.856314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:18.926044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 584/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:43:18 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:43:20.969929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7779ab-f8cb-42f6-bc85-47f703ad61a9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:20.970477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7779ab-f8cb-42f6-bc85-47f703ad61a9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:20.970477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7779ab-f8cb-42f6-bc85-47f703ad61a9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:20.971707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 590/1174] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:20.977340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542afec-bfc6-4b86-9b00-80c25a9036eb None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:20.977726 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542afec-bfc6-4b86-9b00-80c25a9036eb None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:20.977878 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542afec-bfc6-4b86-9b00-80c25a9036eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:20.995205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-6542afec-bfc6-4b86-9b00-80c25a9036eb None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:20.996348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6542afec-bfc6-4b86-9b00-80c25a9036eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:21.065046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 585/1175] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:43:21.089333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7779ab-f8cb-42f6-bc85-47f703ad61a9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:21.188432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7779ab-f8cb-42f6-bc85-47f703ad61a9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:21.221158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25051f84-909f-438c-a5e6-5778c7ddc38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:21.221722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051f84-909f-438c-a5e6-5778c7ddc38a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:21.221996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051f84-909f-438c-a5e6-5778c7ddc38a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:21.222259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051f84-909f-438c-a5e6-5778c7ddc38a None admin] PATH_INFO: `/v3/domains/896e4baae68142a99e572c7a0150d385` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:21.223607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25051f84-909f-438c-a5e6-5778c7ddc38a None admin] RBAC: Authorizing `identity:get_domain(domain_id=896e4baae68142a99e572c7a0150d385)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:21.225066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25051f84-909f-438c-a5e6-5778c7ddc38a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:21.226697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 591/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Wed Aug 10 22:43:21 2022] GET /identity/v3/domains/896e4baae68142a99e572c7a0150d385 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:21.232493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542afec-bfc6-4b86-9b00-80c25a9036eb None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:21.329183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542afec-bfc6-4b86-9b00-80c25a9036eb None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:21.351881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:21.363186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c434de-cdda-4193-9be7-b2e44350ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:21.363779 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c434de-cdda-4193-9be7-b2e44350ee8e None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:21.367873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c434de-cdda-4193-9be7-b2e44350ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:21.367873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c434de-cdda-4193-9be7-b2e44350ee8e None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:21.367873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c434de-cdda-4193-9be7-b2e44350ee8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:21.367873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c434de-cdda-4193-9be7-b2e44350ee8e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:21.478261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 586/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:43:21 2022] POST /identity/v3/users => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:43:23.513472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d023eb-7909-49af-a47e-65cf6663f746 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:23.514033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d023eb-7909-49af-a47e-65cf6663f746 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:23.514033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d023eb-7909-49af-a47e-65cf6663f746 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:23.515344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 592/1178] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:23.521026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f08b5-c8ff-49d9-9f1a-852ed6b5d59f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:23.521483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f08b5-c8ff-49d9-9f1a-852ed6b5d59f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:23.521583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f08b5-c8ff-49d9-9f1a-852ed6b5d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:23.539630 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-fc7f08b5-c8ff-49d9-9f1a-852ed6b5d59f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:23.540788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fc7f08b5-c8ff-49d9-9f1a-852ed6b5d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:23.604932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 587/1179] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:43:23.627358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d023eb-7909-49af-a47e-65cf6663f746 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:23.679455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:23.733053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d023eb-7909-49af-a47e-65cf6663f746 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:23.765222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcd99b-2bbe-402d-b00e-e1b1b5e342aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:23.766337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcd99b-2bbe-402d-b00e-e1b1b5e342aa None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:23.766616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcd99b-2bbe-402d-b00e-e1b1b5e342aa None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:23.766886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcd99b-2bbe-402d-b00e-e1b1b5e342aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:23.777250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcd99b-2bbe-402d-b00e-e1b1b5e342aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-9abcd99b-2bbe-402d-b00e-e1b1b5e342aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:43:23.782602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:43:23.783723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:43:23.784778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 593/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:43:23.789858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f08b5-c8ff-49d9-9f1a-852ed6b5d59f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:23.884499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f08b5-c8ff-49d9-9f1a-852ed6b5d59f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:23.894363 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:23.917662 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e0c1e-7d45-4577-ad97-4314e5704d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:23.918260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e0c1e-7d45-4577-ad97-4314e5704d97 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:23.918529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e0c1e-7d45-4577-ad97-4314e5704d97 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:23.918795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e0c1e-7d45-4577-ad97-4314e5704d97 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:23.919473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e0c1e-7d45-4577-ad97-4314e5704d97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:23.919775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e0c1e-7d45-4577-ad97-4314e5704d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:23.921117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e0c1e-7d45-4577-ad97-4314e5704d97 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:23.928790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 588/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:43:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:23.934790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcd99b-2bbe-402d-b00e-e1b1b5e342aa None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:24.031087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcd99b-2bbe-402d-b00e-e1b1b5e342aa None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:24.039346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:24.062248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5509349-e574-4a11-92c0-02108855d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:24.063386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5509349-e574-4a11-92c0-02108855d8ac None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:24.063657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5509349-e574-4a11-92c0-02108855d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:24.063921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5509349-e574-4a11-92c0-02108855d8ac None admin] PATH_INFO: `/v3/users/807a173149524d4685ed442e52d87c30` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:24.076154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5509349-e574-4a11-92c0-02108855d8ac None admin] RBAC: Authorizing `identity:get_user(user_id=807a173149524d4685ed442e52d87c30)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:24.077596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5509349-e574-4a11-92c0-02108855d8ac None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:24.079774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 594/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:43:23 2022] GET /identity/v3/users/807a173149524d4685ed442e52d87c30 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:24.085772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e0c1e-7d45-4577-ad97-4314e5704d97 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:24.182502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e0c1e-7d45-4577-ad97-4314e5704d97 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:24.215193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d921e-2687-4ca9-a4fe-5ce5e246b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:24.215783 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d921e-2687-4ca9-a4fe-5ce5e246b894 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:24.216055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d921e-2687-4ca9-a4fe-5ce5e246b894 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:24.216320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d921e-2687-4ca9-a4fe-5ce5e246b894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:24.254700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:24.281501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d921e-2687-4ca9-a4fe-5ce5e246b894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:24.282901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d921e-2687-4ca9-a4fe-5ce5e246b894 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:24.383062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 589/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:43:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:43:24.389048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5509349-e574-4a11-92c0-02108855d8ac None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:24.489097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5509349-e574-4a11-92c0-02108855d8ac None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:24.523144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96637f82-ec74-4736-949f-79d4cd66bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:24.523832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96637f82-ec74-4736-949f-79d4cd66bc6e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:24.524031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96637f82-ec74-4736-949f-79d4cd66bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:24.524298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96637f82-ec74-4736-949f-79d4cd66bc6e None admin] PATH_INFO: `/v3/projects/b5f2c70bb601422d8dafc3db6db3cebe` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:24.525433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96637f82-ec74-4736-949f-79d4cd66bc6e None admin] RBAC: Authorizing `identity:get_project(project_id=b5f2c70bb601422d8dafc3db6db3cebe)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:24.526865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96637f82-ec74-4736-949f-79d4cd66bc6e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:24.528478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 595/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:43:24 2022] GET /identity/v3/projects/b5f2c70bb601422d8dafc3db6db3cebe => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:24.534893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d921e-2687-4ca9-a4fe-5ce5e246b894 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:24.604390 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:24.637020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d921e-2687-4ca9-a4fe-5ce5e246b894 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:24.672768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c3117-7cb6-40ef-b21c-930e1e839dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:24.673395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c3117-7cb6-40ef-b21c-930e1e839dd2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:24.673702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c3117-7cb6-40ef-b21c-930e1e839dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:24.673980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c3117-7cb6-40ef-b21c-930e1e839dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:24.674687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c3117-7cb6-40ef-b21c-930e1e839dd2 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=b5f2c70bb601422d8dafc3db6db3cebe, user.id=807a173149524d4685ed442e52d87c30) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:24.675074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c3117-7cb6-40ef-b21c-930e1e839dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:24.676414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c3117-7cb6-40ef-b21c-930e1e839dd2 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:24.681987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 590/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:43:24 2022] GET /identity/v3/role_assignments?user.id=807a173149524d4685ed442e52d87c30&scope.project.id=b5f2c70bb601422d8dafc3db6db3cebe&role.id=edba0d8c079245a38a321d2d77d25419 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:26.703821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d9e97-235f-4194-a2ef-e7e4af23f9ae None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:26.704347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d9e97-235f-4194-a2ef-e7e4af23f9ae None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:26.704347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d9e97-235f-4194-a2ef-e7e4af23f9ae None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:26.705688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 596/1186] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:26.710826 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0fecd-ceb8-49f5-9ddf-876f1993b1aa None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:26.711258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0fecd-ceb8-49f5-9ddf-876f1993b1aa None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:26.711377 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0fecd-ceb8-49f5-9ddf-876f1993b1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:26.729090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-a6e0fecd-ceb8-49f5-9ddf-876f1993b1aa None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:26.730291 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a6e0fecd-ceb8-49f5-9ddf-876f1993b1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:26.794851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 591/1187] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:43:26.817702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d9e97-235f-4194-a2ef-e7e4af23f9ae None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:26.853651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:26.917380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d9e97-235f-4194-a2ef-e7e4af23f9ae None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:26.949687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed145a58-d498-4726-bc78-2e74a8a32082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:26.950292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145a58-d498-4726-bc78-2e74a8a32082 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:26.950566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145a58-d498-4726-bc78-2e74a8a32082 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:26.950834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed145a58-d498-4726-bc78-2e74a8a32082 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:26.961083 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed145a58-d498-4726-bc78-2e74a8a32082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ed145a58-d498-4726-bc78-2e74a8a32082 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:43:26.965740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:43:26.966809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:43:26.967659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 597/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:43:26.973199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0fecd-ceb8-49f5-9ddf-876f1993b1aa None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:27.033682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:27.071068 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0fecd-ceb8-49f5-9ddf-876f1993b1aa None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:27.104471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374955b6-a3d2-4849-8803-6eeb8a20efc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:27.105071 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374955b6-a3d2-4849-8803-6eeb8a20efc3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:27.105370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374955b6-a3d2-4849-8803-6eeb8a20efc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:27.105640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374955b6-a3d2-4849-8803-6eeb8a20efc3 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:27.106292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374955b6-a3d2-4849-8803-6eeb8a20efc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:27.106589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374955b6-a3d2-4849-8803-6eeb8a20efc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:27.107929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374955b6-a3d2-4849-8803-6eeb8a20efc3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:27.115925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 592/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:27.121851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed145a58-d498-4726-bc78-2e74a8a32082 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:27.215777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:27.222293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed145a58-d498-4726-bc78-2e74a8a32082 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:27.256698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ad25-47e7-46c4-8765-c235241330c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:27.257334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ad25-47e7-46c4-8765-c235241330c6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:27.257613 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ad25-47e7-46c4-8765-c235241330c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:27.257877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ad25-47e7-46c4-8765-c235241330c6 None admin] PATH_INFO: `/v3/users/807a173149524d4685ed442e52d87c30` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:27.258979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ad25-47e7-46c4-8765-c235241330c6 None admin] RBAC: Authorizing `identity:get_user(user_id=807a173149524d4685ed442e52d87c30)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:27.260394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ad25-47e7-46c4-8765-c235241330c6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:27.261981 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 598/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:43:27 2022] GET /identity/v3/users/807a173149524d4685ed442e52d87c30 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:27.267804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374955b6-a3d2-4849-8803-6eeb8a20efc3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:27.368190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374955b6-a3d2-4849-8803-6eeb8a20efc3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:27.397034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:27.405698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bf078-b78b-4133-b0ed-2653f6e50c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:27.406354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bf078-b78b-4133-b0ed-2653f6e50c71 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:27.406622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bf078-b78b-4133-b0ed-2653f6e50c71 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:27.407336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bf078-b78b-4133-b0ed-2653f6e50c71 None admin] PATH_INFO: `/v3/projects/b5f2c70bb601422d8dafc3db6db3cebe` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:27.408118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bf078-b78b-4133-b0ed-2653f6e50c71 None admin] RBAC: Authorizing `identity:get_project(project_id=b5f2c70bb601422d8dafc3db6db3cebe)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:27.409611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bf078-b78b-4133-b0ed-2653f6e50c71 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:27.411748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 593/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:43:27 2022] GET /identity/v3/projects/b5f2c70bb601422d8dafc3db6db3cebe => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:27.418625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ad25-47e7-46c4-8765-c235241330c6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:27.517622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ad25-47e7-46c4-8765-c235241330c6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:27.551530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc6662-7a62-4de6-9384-67a6a9fb9a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:27.552175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6662-7a62-4de6-9384-67a6a9fb9a53 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:27.552449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6662-7a62-4de6-9384-67a6a9fb9a53 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:27.552713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6662-7a62-4de6-9384-67a6a9fb9a53 None admin] PATH_INFO: `/v3/projects/b5f2c70bb601422d8dafc3db6db3cebe/users/807a173149524d4685ed442e52d87c30/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:27.554679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc6662-7a62-4de6-9384-67a6a9fb9a53 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5f2c70bb601422d8dafc3db6db3cebe, user_id=807a173149524d4685ed442e52d87c30, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:27.556126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc6662-7a62-4de6-9384-67a6a9fb9a53 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:27.615272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 599/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:43:27 2022] PUT /identity/v3/projects/b5f2c70bb601422d8dafc3db6db3cebe/users/807a173149524d4685ed442e52d87c30/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:43:29.594335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422d63f-fecc-4a7f-a10c-49b86d818787 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:29.594848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422d63f-fecc-4a7f-a10c-49b86d818787 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:29.594848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422d63f-fecc-4a7f-a10c-49b86d818787 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:29.596188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 594/1193] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:43:29.601810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d08461-01d0-47c9-b5f4-2618380c4f78 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:29.602242 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d08461-01d0-47c9-b5f4-2618380c4f78 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:29.602350 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d08461-01d0-47c9-b5f4-2618380c4f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:29.620636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f7d08461-01d0-47c9-b5f4-2618380c4f78 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:43:29.621843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f7d08461-01d0-47c9-b5f4-2618380c4f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:43:29.638598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:29.687972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 600/1194] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:43:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:43:29.710741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422d63f-fecc-4a7f-a10c-49b86d818787 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:29.809807 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422d63f-fecc-4a7f-a10c-49b86d818787 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:29.842054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1ff27-ad93-426e-b2df-2ca2eb8df26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:29.842661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1ff27-ad93-426e-b2df-2ca2eb8df26d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:29.842930 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1ff27-ad93-426e-b2df-2ca2eb8df26d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:29.843190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1ff27-ad93-426e-b2df-2ca2eb8df26d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:29.853018 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1ff27-ad93-426e-b2df-2ca2eb8df26d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-61a1ff27-ad93-426e-b2df-2ca2eb8df26d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:43:29.857618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:43:29.858735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:43:29.860116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 595/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:43:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:43:29.865507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d08461-01d0-47c9-b5f4-2618380c4f78 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:29.960173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d08461-01d0-47c9-b5f4-2618380c4f78 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:29.993268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bda8b9-7eab-4fc6-85f4-3312333692a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:29.993883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bda8b9-7eab-4fc6-85f4-3312333692a7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:29.994155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bda8b9-7eab-4fc6-85f4-3312333692a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:29.994419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bda8b9-7eab-4fc6-85f4-3312333692a7 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:29.995067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bda8b9-7eab-4fc6-85f4-3312333692a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:29.995362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bda8b9-7eab-4fc6-85f4-3312333692a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:29.996699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bda8b9-7eab-4fc6-85f4-3312333692a7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:30.004358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 601/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:43:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:30.010162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1ff27-ad93-426e-b2df-2ca2eb8df26d None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:30.063538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:30.104674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1ff27-ad93-426e-b2df-2ca2eb8df26d None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:30.136814 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e16cda-5809-43d0-a674-4765c3692a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:30.137443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e16cda-5809-43d0-a674-4765c3692a92 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:30.137716 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e16cda-5809-43d0-a674-4765c3692a92 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:30.137979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e16cda-5809-43d0-a674-4765c3692a92 None admin] PATH_INFO: `/v3/users/807a173149524d4685ed442e52d87c30` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:30.139062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e16cda-5809-43d0-a674-4765c3692a92 None admin] RBAC: Authorizing `identity:get_user(user_id=807a173149524d4685ed442e52d87c30)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:30.140480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e16cda-5809-43d0-a674-4765c3692a92 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:30.142046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 596/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Wed Aug 10 22:43:30 2022] GET /identity/v3/users/807a173149524d4685ed442e52d87c30 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:30.147828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bda8b9-7eab-4fc6-85f4-3312333692a7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:30.164047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:30.244546 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bda8b9-7eab-4fc6-85f4-3312333692a7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:30.276457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3aa87-0f79-4e6e-8c93-e74c43668529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:30.277041 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3aa87-0f79-4e6e-8c93-e74c43668529 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:30.277337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3aa87-0f79-4e6e-8c93-e74c43668529 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:30.277604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3aa87-0f79-4e6e-8c93-e74c43668529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:30.341643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3aa87-0f79-4e6e-8c93-e74c43668529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:30.343008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3aa87-0f79-4e6e-8c93-e74c43668529 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:30.358344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:30.439326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 602/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:43:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:43:30.445282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e16cda-5809-43d0-a674-4765c3692a92 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:30.541821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e16cda-5809-43d0-a674-4765c3692a92 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:30.564429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:30.575644 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b1196-aa55-45d5-8466-a58639ad0c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:30.576262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b1196-aa55-45d5-8466-a58639ad0c0b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:30.578496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b1196-aa55-45d5-8466-a58639ad0c0b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:30.578496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b1196-aa55-45d5-8466-a58639ad0c0b None admin] PATH_INFO: `/v3/projects/b5f2c70bb601422d8dafc3db6db3cebe` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:30.578496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b1196-aa55-45d5-8466-a58639ad0c0b None admin] RBAC: Authorizing `identity:get_project(project_id=b5f2c70bb601422d8dafc3db6db3cebe)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:30.579828 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b1196-aa55-45d5-8466-a58639ad0c0b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:30.581473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 597/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Wed Aug 10 22:43:30 2022] GET /identity/v3/projects/b5f2c70bb601422d8dafc3db6db3cebe => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:43:30.587608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3aa87-0f79-4e6e-8c93-e74c43668529 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:43:30.683598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3aa87-0f79-4e6e-8c93-e74c43668529 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:43:30.697437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:30.717055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2e913-936e-4576-a469-bec1c491bc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:43:30.717676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2e913-936e-4576-a469-bec1c491bc43 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:43:30.717944 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2e913-936e-4576-a469-bec1c491bc43 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:43:30.718205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2e913-936e-4576-a469-bec1c491bc43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:43:30.718959 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2e913-936e-4576-a469-bec1c491bc43 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=b5f2c70bb601422d8dafc3db6db3cebe, user.id=807a173149524d4685ed442e52d87c30) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:43:30.719256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2e913-936e-4576-a469-bec1c491bc43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:43:30.720676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2e913-936e-4576-a469-bec1c491bc43 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:43:30.726987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 603/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:43:30 2022] GET /identity/v3/role_assignments?user.id=807a173149524d4685ed442e52d87c30&scope.project.id=b5f2c70bb601422d8dafc3db6db3cebe&role.id=edba0d8c079245a38a321d2d77d25419 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:43:40.603011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=5 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:43:40.728806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=11 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:47.926366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760960a5-e85c-4232-be75-28f9df594e2c None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:47.927008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760960a5-e85c-4232-be75-28f9df594e2c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:47.927008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760960a5-e85c-4232-be75-28f9df594e2c None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:47.928189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 598/1201] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:44:47.934666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e01b70-fbc8-45c4-9dad-af1d9ae5d8fc None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:47.935132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e01b70-fbc8-45c4-9dad-af1d9ae5d8fc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:47.935237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e01b70-fbc8-45c4-9dad-af1d9ae5d8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:47.955453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-08e01b70-fbc8-45c4-9dad-af1d9ae5d8fc None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:44:47.956657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-08e01b70-fbc8-45c4-9dad-af1d9ae5d8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:44:48.031871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 604/1202] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:44:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 22:44:48.056677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760960a5-e85c-4232-be75-28f9df594e2c None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:48.173236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760960a5-e85c-4232-be75-28f9df594e2c None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:48.216616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dce670-c583-4175-91e1-e5f716fdc453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:48.217132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dce670-c583-4175-91e1-e5f716fdc453 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:48.217437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dce670-c583-4175-91e1-e5f716fdc453 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:48.217706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dce670-c583-4175-91e1-e5f716fdc453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:48.231713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dce670-c583-4175-91e1-e5f716fdc453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:48.233149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dce670-c583-4175-91e1-e5f716fdc453 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-c8dce670-c583-4175-91e1-e5f716fdc453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:44:48.249496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:48.251412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:44:48.253168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:44:48.253168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:48.253168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:44:48.253168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 599/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:48.260900 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e01b70-fbc8-45c4-9dad-af1d9ae5d8fc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:48.388684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e01b70-fbc8-45c4-9dad-af1d9ae5d8fc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:48.419860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:48.426229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82584f5-623e-4f51-8497-1f04d73a3988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:48.427493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82584f5-623e-4f51-8497-1f04d73a3988 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:48.427773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82584f5-623e-4f51-8497-1f04d73a3988 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:48.428077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82584f5-623e-4f51-8497-1f04d73a3988 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:48.428731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82584f5-623e-4f51-8497-1f04d73a3988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:48.429022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82584f5-623e-4f51-8497-1f04d73a3988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:48.430594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82584f5-623e-4f51-8497-1f04d73a3988 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:48.442875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 605/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:48.448654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dce670-c583-4175-91e1-e5f716fdc453 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:48.506440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:48.558663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dce670-c583-4175-91e1-e5f716fdc453 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:48.594169 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7313d-7c40-4515-a0cb-855ca897082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:48.594787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7313d-7c40-4515-a0cb-855ca897082d None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:48.595061 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7313d-7c40-4515-a0cb-855ca897082d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:48.595322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7313d-7c40-4515-a0cb-855ca897082d None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:48.595953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7313d-7c40-4515-a0cb-855ca897082d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:48.597660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7313d-7c40-4515-a0cb-855ca897082d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:48.698003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 600/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Wed Aug 10 22:44:48 2022] POST /identity/v3/users => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:44:50.888433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0b53-7411-44b3-9346-18d009be46ac None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:50.888934 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0b53-7411-44b3-9346-18d009be46ac None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:50.888934 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0b53-7411-44b3-9346-18d009be46ac None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:50.890442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 606/1206] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:44:50.896425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e1432-26bd-4c07-ba5e-e6974fca32e1 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:50.901501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e1432-26bd-4c07-ba5e-e6974fca32e1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:50.901501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e1432-26bd-4c07-ba5e-e6974fca32e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:50.915328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-614e1432-26bd-4c07-ba5e-e6974fca32e1 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:44:50.916520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-614e1432-26bd-4c07-ba5e-e6974fca32e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:44:50.983194 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 601/1207] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:44:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:44:51.007358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0b53-7411-44b3-9346-18d009be46ac None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:51.119871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0b53-7411-44b3-9346-18d009be46ac None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:51.154519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20b87-10af-4e9a-a6c2-5ab34bd595fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:51.155059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20b87-10af-4e9a-a6c2-5ab34bd595fc None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:51.155336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20b87-10af-4e9a-a6c2-5ab34bd595fc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:51.155608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20b87-10af-4e9a-a6c2-5ab34bd595fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:51.166600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d20b87-10af-4e9a-a6c2-5ab34bd595fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-28d20b87-10af-4e9a-a6c2-5ab34bd595fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:44:51.171353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:51.172501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:44:51.173421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 607/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:44:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:51.179003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e1432-26bd-4c07-ba5e-e6974fca32e1 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:51.217439 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:51.274952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e1432-26bd-4c07-ba5e-e6974fca32e1 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:51.309594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310cb1f-de76-408f-b387-70932369e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:51.310188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310cb1f-de76-408f-b387-70932369e6a1 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:51.310456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310cb1f-de76-408f-b387-70932369e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:51.310721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310cb1f-de76-408f-b387-70932369e6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:51.311368 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310cb1f-de76-408f-b387-70932369e6a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:51.311660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310cb1f-de76-408f-b387-70932369e6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:51.312990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310cb1f-de76-408f-b387-70932369e6a1 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:51.321364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 602/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:44:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:51.327157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20b87-10af-4e9a-a6c2-5ab34bd595fc None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:51.378117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:51.430468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20b87-10af-4e9a-a6c2-5ab34bd595fc None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:51.463749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa9d23-3f20-41d9-befe-54e0b52f75d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:51.466138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa9d23-3f20-41d9-befe-54e0b52f75d3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:51.466138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa9d23-3f20-41d9-befe-54e0b52f75d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:51.466138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa9d23-3f20-41d9-befe-54e0b52f75d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:51.476678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa9d23-3f20-41d9-befe-54e0b52f75d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:51.478240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa9d23-3f20-41d9-befe-54e0b52f75d3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-c4fa9d23-3f20-41d9-befe-54e0b52f75d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:44:51.493110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:51.494325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:44:51.495501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:44:51.495501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:51.495501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:44:51.495501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 608/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:51.500105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310cb1f-de76-408f-b387-70932369e6a1 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:51.604952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:51.607863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310cb1f-de76-408f-b387-70932369e6a1 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:51.641306 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf319d4-b150-43eb-9962-f5dc9adccefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:51.641911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf319d4-b150-43eb-9962-f5dc9adccefe None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:51.642183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf319d4-b150-43eb-9962-f5dc9adccefe None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:51.642449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf319d4-b150-43eb-9962-f5dc9adccefe None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:51.643077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf319d4-b150-43eb-9962-f5dc9adccefe None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:51.643371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf319d4-b150-43eb-9962-f5dc9adccefe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:51.644718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf319d4-b150-43eb-9962-f5dc9adccefe None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:51.656669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 603/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:51.662467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa9d23-3f20-41d9-befe-54e0b52f75d3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:51.763643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa9d23-3f20-41d9-befe-54e0b52f75d3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:51.765689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:51.800792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d3362-5730-4f86-94a9-dfceca9965eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:51.801962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d3362-5730-4f86-94a9-dfceca9965eb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:51.802236 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d3362-5730-4f86-94a9-dfceca9965eb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:51.802501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d3362-5730-4f86-94a9-dfceca9965eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:51.810488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d3362-5730-4f86-94a9-dfceca9965eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:51.811906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d3362-5730-4f86-94a9-dfceca9965eb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-135d3362-5730-4f86-94a9-dfceca9965eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:44:51.823747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:51.824921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:44:51.826344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 609/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:44:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:51.830746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf319d4-b150-43eb-9962-f5dc9adccefe None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:51.930893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf319d4-b150-43eb-9962-f5dc9adccefe None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:51.963429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6a5a1-f41a-4352-aaaa-19d54635790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:51.964136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6a5a1-f41a-4352-aaaa-19d54635790f None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:51.964408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6a5a1-f41a-4352-aaaa-19d54635790f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:51.964673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6a5a1-f41a-4352-aaaa-19d54635790f None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:51.965410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6a5a1-f41a-4352-aaaa-19d54635790f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:51.965709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6a5a1-f41a-4352-aaaa-19d54635790f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:51.967108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6a5a1-f41a-4352-aaaa-19d54635790f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:51.984498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 604/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Aug 10 22:44:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:51.990874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d3362-5730-4f86-94a9-dfceca9965eb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:52.094912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d3362-5730-4f86-94a9-dfceca9965eb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:52.130194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bc229-9e7c-46e8-8679-8e25cb0c45bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:52.130790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc229-9e7c-46e8-8679-8e25cb0c45bd None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:52.131069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc229-9e7c-46e8-8679-8e25cb0c45bd None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:52.131342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bc229-9e7c-46e8-8679-8e25cb0c45bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:52.161485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:52.198545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bc229-9e7c-46e8-8679-8e25cb0c45bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:52.199998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bc229-9e7c-46e8-8679-8e25cb0c45bd None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:52.300598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 610/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:44:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:44:52.307141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6a5a1-f41a-4352-aaaa-19d54635790f None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:52.325801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:52.406476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6a5a1-f41a-4352-aaaa-19d54635790f None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:52.444515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce2407-cc1c-40df-8375-53ec30d5ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:52.447196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce2407-cc1c-40df-8375-53ec30d5ccee None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:52.447196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce2407-cc1c-40df-8375-53ec30d5ccee None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:52.447196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce2407-cc1c-40df-8375-53ec30d5ccee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:52.455698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce2407-cc1c-40df-8375-53ec30d5ccee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:52.457111 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce2407-cc1c-40df-8375-53ec30d5ccee None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-86ce2407-cc1c-40df-8375-53ec30d5ccee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:44:52.472147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:52.473748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:44:52.474943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:44:52.474943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:52.474943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:44:52.474943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 605/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:52.479726 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bc229-9e7c-46e8-8679-8e25cb0c45bd None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:52.542255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:52.579480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bc229-9e7c-46e8-8679-8e25cb0c45bd None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:52.614926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7419a-eddc-48dd-b414-a7b29a1e4c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:52.615513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7419a-eddc-48dd-b414-a7b29a1e4c3b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:52.615788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7419a-eddc-48dd-b414-a7b29a1e4c3b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:52.616079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7419a-eddc-48dd-b414-a7b29a1e4c3b None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:52.616709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7419a-eddc-48dd-b414-a7b29a1e4c3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:52.617003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7419a-eddc-48dd-b414-a7b29a1e4c3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:52.618414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7419a-eddc-48dd-b414-a7b29a1e4c3b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:52.631054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 611/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:52.636312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce2407-cc1c-40df-8375-53ec30d5ccee None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:52.715726 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:52.748229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce2407-cc1c-40df-8375-53ec30d5ccee None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:52.782498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac07e98-ce93-40bf-943d-89ff31ae96bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:52.783154 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac07e98-ce93-40bf-943d-89ff31ae96bc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:52.783428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac07e98-ce93-40bf-943d-89ff31ae96bc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:52.783697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac07e98-ce93-40bf-943d-89ff31ae96bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:52.791244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac07e98-ce93-40bf-943d-89ff31ae96bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:52.792665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac07e98-ce93-40bf-943d-89ff31ae96bc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-1ac07e98-ce93-40bf-943d-89ff31ae96bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:44:52.804034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:52.805210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:52.806544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:44:52.806544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:44:52.806544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:44:52.806544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:44:52.806544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:44:52.806544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:44:52.806544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:44:52.806544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:44:52.806544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 606/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:52.811044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7419a-eddc-48dd-b414-a7b29a1e4c3b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:52.917067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7419a-eddc-48dd-b414-a7b29a1e4c3b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:52.938656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:52.950109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24d3e3-a52c-46cc-9ee8-1c8609425241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:52.950706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d3e3-a52c-46cc-9ee8-1c8609425241 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:52.950975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d3e3-a52c-46cc-9ee8-1c8609425241 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:52.951238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d3e3-a52c-46cc-9ee8-1c8609425241 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:52.951917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24d3e3-a52c-46cc-9ee8-1c8609425241 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:52.952215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24d3e3-a52c-46cc-9ee8-1c8609425241 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:52.953663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24d3e3-a52c-46cc-9ee8-1c8609425241 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:52.966099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 612/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:52.972506 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac07e98-ce93-40bf-943d-89ff31ae96bc None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:53.084174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac07e98-ce93-40bf-943d-89ff31ae96bc None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:53.112499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:53.118967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758107d-4c77-4919-a34f-7efd6a8edf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:53.119564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758107d-4c77-4919-a34f-7efd6a8edf70 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:53.119833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758107d-4c77-4919-a34f-7efd6a8edf70 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:53.120095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758107d-4c77-4919-a34f-7efd6a8edf70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:53.120808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758107d-4c77-4919-a34f-7efd6a8edf70 None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=6d9439b0577446f1ae9ff61a23df4143) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:53.121107 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758107d-4c77-4919-a34f-7efd6a8edf70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:53.122551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758107d-4c77-4919-a34f-7efd6a8edf70 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:53.128251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 607/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:44:52 2022] GET /identity/v3/role_assignments?user.id=6d9439b0577446f1ae9ff61a23df4143&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:55.130394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc6353-e09c-4347-a495-2a28e46be490 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:55.130975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc6353-e09c-4347-a495-2a28e46be490 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:55.130975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc6353-e09c-4347-a495-2a28e46be490 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:55.132222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 613/1220] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:44:55.137562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81fbc-cdef-40e3-b60c-77e44dcaba4d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:55.137955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81fbc-cdef-40e3-b60c-77e44dcaba4d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:55.138146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81fbc-cdef-40e3-b60c-77e44dcaba4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:55.155966 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-34f81fbc-cdef-40e3-b60c-77e44dcaba4d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:44:55.157151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-34f81fbc-cdef-40e3-b60c-77e44dcaba4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:44:55.231230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 608/1221] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:44:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:44:55.254081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc6353-e09c-4347-a495-2a28e46be490 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:55.359353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc6353-e09c-4347-a495-2a28e46be490 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:55.396194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4ba83-cbb9-4f26-be7c-cd54d963ab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:55.396732 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4ba83-cbb9-4f26-be7c-cd54d963ab7f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:55.397006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4ba83-cbb9-4f26-be7c-cd54d963ab7f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:55.397272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4ba83-cbb9-4f26-be7c-cd54d963ab7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:55.407613 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4ba83-cbb9-4f26-be7c-cd54d963ab7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-52b4ba83-cbb9-4f26-be7c-cd54d963ab7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:44:55.412833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:55.413935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:44:55.414993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 614/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:55.420317 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f81fbc-cdef-40e3-b60c-77e44dcaba4d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:55.518734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f81fbc-cdef-40e3-b60c-77e44dcaba4d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:55.544203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:55.555168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b242c56-bd97-46d3-8771-041ee7fda64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:55.555770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b242c56-bd97-46d3-8771-041ee7fda64d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:55.556045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b242c56-bd97-46d3-8771-041ee7fda64d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:55.556407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b242c56-bd97-46d3-8771-041ee7fda64d None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:55.556963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b242c56-bd97-46d3-8771-041ee7fda64d None admin] RBAC: Adding query filter params (name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:55.557260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b242c56-bd97-46d3-8771-041ee7fda64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:55.558633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b242c56-bd97-46d3-8771-041ee7fda64d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:55.566737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 609/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:55.572495 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4ba83-cbb9-4f26-be7c-cd54d963ab7f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:55.616068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:55.696623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4ba83-cbb9-4f26-be7c-cd54d963ab7f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:55.732913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfe326-1055-4704-84ac-312417120cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:55.733572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfe326-1055-4704-84ac-312417120cd8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:55.733876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfe326-1055-4704-84ac-312417120cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:55.734149 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfe326-1055-4704-84ac-312417120cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:55.745333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfe326-1055-4704-84ac-312417120cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:55.746791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfe326-1055-4704-84ac-312417120cd8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-bfcfe326-1055-4704-84ac-312417120cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:44:55.762698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:55.764641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:44:55.766430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:44:55.766430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:55.766430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:44:55.766430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 615/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:55.770576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b242c56-bd97-46d3-8771-041ee7fda64d None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:55.879438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b242c56-bd97-46d3-8771-041ee7fda64d None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:55.913677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582e95b-68d0-41f2-871a-dea15b6e92ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:55.914262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582e95b-68d0-41f2-871a-dea15b6e92ed None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:55.914534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582e95b-68d0-41f2-871a-dea15b6e92ed None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:55.914795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582e95b-68d0-41f2-871a-dea15b6e92ed None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:55.915414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582e95b-68d0-41f2-871a-dea15b6e92ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:55.915703 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582e95b-68d0-41f2-871a-dea15b6e92ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:55.917049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582e95b-68d0-41f2-871a-dea15b6e92ed None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:55.928493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 610/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:55.934229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfe326-1055-4704-84ac-312417120cd8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:56.028585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:56.035040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfe326-1055-4704-84ac-312417120cd8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:56.068364 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332b48-3494-4bf9-a898-6a53507dedec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:56.068977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332b48-3494-4bf9-a898-6a53507dedec None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:56.069254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332b48-3494-4bf9-a898-6a53507dedec None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:56.069559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332b48-3494-4bf9-a898-6a53507dedec None admin] PATH_INFO: `/v3/users/placement` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:56.076939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68332b48-3494-4bf9-a898-6a53507dedec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:56.078408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68332b48-3494-4bf9-a898-6a53507dedec None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-68332b48-3494-4bf9-a898-6a53507dedec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:44:56.090278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:56.091477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:44:56.092712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 616/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:44:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:56.097654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582e95b-68d0-41f2-871a-dea15b6e92ed None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:56.145347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:56.198652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582e95b-68d0-41f2-871a-dea15b6e92ed None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:56.234496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa130-1a2c-47e5-a60a-8f6d06826644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:56.235102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa130-1a2c-47e5-a60a-8f6d06826644 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:56.235376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa130-1a2c-47e5-a60a-8f6d06826644 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:56.235643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fa130-1a2c-47e5-a60a-8f6d06826644 None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:56.236364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fa130-1a2c-47e5-a60a-8f6d06826644 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:56.236720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fa130-1a2c-47e5-a60a-8f6d06826644 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:56.238246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fa130-1a2c-47e5-a60a-8f6d06826644 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:56.256857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 611/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Aug 10 22:44:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:56.262594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332b48-3494-4bf9-a898-6a53507dedec None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:56.366611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68332b48-3494-4bf9-a898-6a53507dedec None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:56.400423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c27f6-2b5b-4533-9047-8b6c909e6bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:56.401036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c27f6-2b5b-4533-9047-8b6c909e6bc7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:56.401324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c27f6-2b5b-4533-9047-8b6c909e6bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:56.401593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c27f6-2b5b-4533-9047-8b6c909e6bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:56.412271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c27f6-2b5b-4533-9047-8b6c909e6bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:56.413741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c27f6-2b5b-4533-9047-8b6c909e6bc7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-062c27f6-2b5b-4533-9047-8b6c909e6bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:44:56.428406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:56.429665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:44:56.430756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:44:56.430756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:56.430756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:44:56.430756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 617/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:56.435726 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa130-1a2c-47e5-a60a-8f6d06826644 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:56.536541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fa130-1a2c-47e5-a60a-8f6d06826644 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:56.538866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:56.571701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7ec84-e53f-428c-ad57-51666fedea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:56.572305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7ec84-e53f-428c-ad57-51666fedea7c None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:56.572579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7ec84-e53f-428c-ad57-51666fedea7c None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:56.572846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7ec84-e53f-428c-ad57-51666fedea7c None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:56.573513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7ec84-e53f-428c-ad57-51666fedea7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:56.573810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7ec84-e53f-428c-ad57-51666fedea7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:56.575153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7ec84-e53f-428c-ad57-51666fedea7c None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:56.586249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 612/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:56.592197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c27f6-2b5b-4533-9047-8b6c909e6bc7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:56.602149 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:56.696595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c27f6-2b5b-4533-9047-8b6c909e6bc7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:56.735293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53e351-6303-485e-a8b4-7afaceb4b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:56.735907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53e351-6303-485e-a8b4-7afaceb4b16b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:56.736178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53e351-6303-485e-a8b4-7afaceb4b16b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:56.736442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53e351-6303-485e-a8b4-7afaceb4b16b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:56.743800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53e351-6303-485e-a8b4-7afaceb4b16b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:56.745212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53e351-6303-485e-a8b4-7afaceb4b16b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-de53e351-6303-485e-a8b4-7afaceb4b16b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:44:56.756543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:56.757718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:56.758641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:44:56.758641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:44:56.758641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:44:56.758641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:44:56.758641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:44:56.758641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:44:56.758641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:44:56.758641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:44:56.758641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 618/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:56.763907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7ec84-e53f-428c-ad57-51666fedea7c None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:56.869163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7ec84-e53f-428c-ad57-51666fedea7c None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:56.902554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744f4ce-8e97-4166-a1ac-2031411e04d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:56.903160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f4ce-8e97-4166-a1ac-2031411e04d2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:56.903433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f4ce-8e97-4166-a1ac-2031411e04d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:56.903700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744f4ce-8e97-4166-a1ac-2031411e04d2 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:56.904382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744f4ce-8e97-4166-a1ac-2031411e04d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:56.904682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744f4ce-8e97-4166-a1ac-2031411e04d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:56.906136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744f4ce-8e97-4166-a1ac-2031411e04d2 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:56.919460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 613/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:56.926671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53e351-6303-485e-a8b4-7afaceb4b16b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:56.997835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:57.036409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53e351-6303-485e-a8b4-7afaceb4b16b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:57.072886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d0e8-315a-4b44-a5f6-0dc6ea1d7fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:57.073567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d0e8-315a-4b44-a5f6-0dc6ea1d7fb6 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:57.073855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d0e8-315a-4b44-a5f6-0dc6ea1d7fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:57.074114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d0e8-315a-4b44-a5f6-0dc6ea1d7fb6 None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/6d9439b0577446f1ae9ff61a23df4143/roles/4287d802f16f48e99bde5dad08836906` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:57.091131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d0e8-315a-4b44-a5f6-0dc6ea1d7fb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=6d9439b0577446f1ae9ff61a23df4143, role_id=4287d802f16f48e99bde5dad08836906)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:57.092581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d0e8-315a-4b44-a5f6-0dc6ea1d7fb6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:57.222180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 619/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:44:56 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/6d9439b0577446f1ae9ff61a23df4143/roles/4287d802f16f48e99bde5dad08836906 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:44:59.234986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f1fcd-caed-4fa1-8c16-456c0f3c862d None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:59.235521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f1fcd-caed-4fa1-8c16-456c0f3c862d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:59.235641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f1fcd-caed-4fa1-8c16-456c0f3c862d None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:59.237095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 614/1233] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:44:59.243221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6442d-7edf-41d3-96fd-83e852fe722e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:59.243656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6442d-7edf-41d3-96fd-83e852fe722e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:59.243779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6442d-7edf-41d3-96fd-83e852fe722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:59.261718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-35c6442d-7edf-41d3-96fd-83e852fe722e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:44:59.262877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-35c6442d-7edf-41d3-96fd-83e852fe722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:44:59.329623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 620/1234] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:44:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:44:59.354532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f1fcd-caed-4fa1-8c16-456c0f3c862d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:59.379323 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:59.454113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f1fcd-caed-4fa1-8c16-456c0f3c862d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:59.490756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382322-c750-4d30-bd86-dfc46df8fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:59.491310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382322-c750-4d30-bd86-dfc46df8fe55 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:59.491583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382322-c750-4d30-bd86-dfc46df8fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:59.491851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382322-c750-4d30-bd86-dfc46df8fe55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:59.502003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc382322-c750-4d30-bd86-dfc46df8fe55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-fc382322-c750-4d30-bd86-dfc46df8fe55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:44:59.506657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:59.507728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:44:59.508755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 615/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Wed Aug 10 22:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:59.513907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6442d-7edf-41d3-96fd-83e852fe722e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:59.561892 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:59.614517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6442d-7edf-41d3-96fd-83e852fe722e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:59.650962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c63f2-f9bf-4cd1-9c9e-cc8ae95ffb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:59.651576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c63f2-f9bf-4cd1-9c9e-cc8ae95ffb24 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:59.651850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c63f2-f9bf-4cd1-9c9e-cc8ae95ffb24 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:59.652307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c63f2-f9bf-4cd1-9c9e-cc8ae95ffb24 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:59.653514 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c63f2-f9bf-4cd1-9c9e-cc8ae95ffb24 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:59.653851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c63f2-f9bf-4cd1-9c9e-cc8ae95ffb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:59.656531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c63f2-f9bf-4cd1-9c9e-cc8ae95ffb24 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:59.667323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 621/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Wed Aug 10 22:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:44:59.673201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382322-c750-4d30-bd86-dfc46df8fe55 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:59.763721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:59.782729 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382322-c750-4d30-bd86-dfc46df8fe55 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:59.819654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5044f81-3098-49d1-b891-d25561cf0b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:59.820276 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5044f81-3098-49d1-b891-d25561cf0b4e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:59.820551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5044f81-3098-49d1-b891-d25561cf0b4e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:59.820818 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5044f81-3098-49d1-b891-d25561cf0b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:59.832731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5044f81-3098-49d1-b891-d25561cf0b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:59.834219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5044f81-3098-49d1-b891-d25561cf0b4e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-f5044f81-3098-49d1-b891-d25561cf0b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:44:59.848821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:44:59.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:44:59.856095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:44:59.856095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:44:59.856095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:44:59.856095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 616/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:44:59.856409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c63f2-f9bf-4cd1-9c9e-cc8ae95ffb24 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:44:59.958188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c63f2-f9bf-4cd1-9c9e-cc8ae95ffb24 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:44:59.967707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:44:59.992797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae2723-b9ae-4e08-8427-917540784e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:44:59.993427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae2723-b9ae-4e08-8427-917540784e31 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:44:59.993704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae2723-b9ae-4e08-8427-917540784e31 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:44:59.993971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae2723-b9ae-4e08-8427-917540784e31 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:44:59.994609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae2723-b9ae-4e08-8427-917540784e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:44:59.994914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae2723-b9ae-4e08-8427-917540784e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:44:59.996259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae2723-b9ae-4e08-8427-917540784e31 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:00.008156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 622/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:00.014144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5044f81-3098-49d1-b891-d25561cf0b4e None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:00.140188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5044f81-3098-49d1-b891-d25561cf0b4e None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:00.176321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f151ec-ea03-4782-a844-0fbf1628bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:00.177047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f151ec-ea03-4782-a844-0fbf1628bb73 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:00.177340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f151ec-ea03-4782-a844-0fbf1628bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:00.177609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f151ec-ea03-4782-a844-0fbf1628bb73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:00.180825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:00.185522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f151ec-ea03-4782-a844-0fbf1628bb73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:00.186962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f151ec-ea03-4782-a844-0fbf1628bb73 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-c9f151ec-ea03-4782-a844-0fbf1628bb73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:45:00.200591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:00.201737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:00.202776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 617/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:00.208199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae2723-b9ae-4e08-8427-917540784e31 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:00.308839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae2723-b9ae-4e08-8427-917540784e31 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:00.343869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19801e87-7544-4a0f-a0f8-21be6cf3339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:00.344469 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19801e87-7544-4a0f-a0f8-21be6cf3339d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:00.344737 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19801e87-7544-4a0f-a0f8-21be6cf3339d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:00.345004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19801e87-7544-4a0f-a0f8-21be6cf3339d None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:00.345766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19801e87-7544-4a0f-a0f8-21be6cf3339d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:00.346063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19801e87-7544-4a0f-a0f8-21be6cf3339d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:00.347855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19801e87-7544-4a0f-a0f8-21be6cf3339d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:00.367294 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 623/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Aug 10 22:45:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:00.373573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f151ec-ea03-4782-a844-0fbf1628bb73 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:00.490352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f151ec-ea03-4782-a844-0fbf1628bb73 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:00.526039 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c43384-3ac1-4c62-a301-28232040b16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:00.526651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43384-3ac1-4c62-a301-28232040b16d None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:00.526940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43384-3ac1-4c62-a301-28232040b16d None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:00.527186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c43384-3ac1-4c62-a301-28232040b16d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:00.592944 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:00.600411 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c43384-3ac1-4c62-a301-28232040b16d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:00.601893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c43384-3ac1-4c62-a301-28232040b16d None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:00.703858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 618/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:45:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:45:00.709946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19801e87-7544-4a0f-a0f8-21be6cf3339d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:00.741459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:00.824069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19801e87-7544-4a0f-a0f8-21be6cf3339d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:00.865152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b552-1792-4c52-9600-89c1b9da4a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:00.865721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b552-1792-4c52-9600-89c1b9da4a07 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:00.865999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b552-1792-4c52-9600-89c1b9da4a07 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:00.866373 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b552-1792-4c52-9600-89c1b9da4a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:00.876902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996b552-1792-4c52-9600-89c1b9da4a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:00.878430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996b552-1792-4c52-9600-89c1b9da4a07 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-e996b552-1792-4c52-9600-89c1b9da4a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:45:00.895868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:00.899169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:45:00.900040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:45:00.900040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:00.900040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:00.900040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 624/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:00.903567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c43384-3ac1-4c62-a301-28232040b16d None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:01.057554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:01.063778 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c43384-3ac1-4c62-a301-28232040b16d None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:01.101807 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fd892-fc5d-430c-ba09-1f6912fba096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:01.102425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fd892-fc5d-430c-ba09-1f6912fba096 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:01.102697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fd892-fc5d-430c-ba09-1f6912fba096 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:01.102962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fd892-fc5d-430c-ba09-1f6912fba096 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:01.103598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fd892-fc5d-430c-ba09-1f6912fba096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:01.103893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fd892-fc5d-430c-ba09-1f6912fba096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:01.105232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972fd892-fc5d-430c-ba09-1f6912fba096 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:01.117223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 619/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:01.123200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b552-1792-4c52-9600-89c1b9da4a07 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:01.214487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:01.236626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b552-1792-4c52-9600-89c1b9da4a07 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:01.272643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003a642-327f-4e68-aff6-0feb90571de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:01.275313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003a642-327f-4e68-aff6-0feb90571de3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:01.275313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003a642-327f-4e68-aff6-0feb90571de3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:01.275313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003a642-327f-4e68-aff6-0feb90571de3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:01.281360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003a642-327f-4e68-aff6-0feb90571de3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:01.282825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003a642-327f-4e68-aff6-0feb90571de3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5003a642-327f-4e68-aff6-0feb90571de3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:45:01.297658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:01.299004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:01.300731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:45:01.300731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:45:01.300731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:45:01.300731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:45:01.300731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:45:01.300731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:45:01.300731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:45:01.300731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:01.300731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 625/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:01.306748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fd892-fc5d-430c-ba09-1f6912fba096 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:01.419001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972fd892-fc5d-430c-ba09-1f6912fba096 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:01.455597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19633c8-a9cb-4114-866c-0cdf70d446ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:01.456214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19633c8-a9cb-4114-866c-0cdf70d446ac None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:01.456488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19633c8-a9cb-4114-866c-0cdf70d446ac None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:01.456792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19633c8-a9cb-4114-866c-0cdf70d446ac None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:01.458023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19633c8-a9cb-4114-866c-0cdf70d446ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:01.458326 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19633c8-a9cb-4114-866c-0cdf70d446ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:01.459737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19633c8-a9cb-4114-866c-0cdf70d446ac None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:01.472395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 620/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:01.478715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003a642-327f-4e68-aff6-0feb90571de3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:01.585971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003a642-327f-4e68-aff6-0feb90571de3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:01.620851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b5d7f-0fa2-49f9-a99b-6bd1225c6263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:01.621471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5d7f-0fa2-49f9-a99b-6bd1225c6263 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:01.621747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5d7f-0fa2-49f9-a99b-6bd1225c6263 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:01.622011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5d7f-0fa2-49f9-a99b-6bd1225c6263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:01.622731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b5d7f-0fa2-49f9-a99b-6bd1225c6263 None admin] RBAC: Adding query filter params (role.id=4287d802f16f48e99bde5dad08836906, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=6d9439b0577446f1ae9ff61a23df4143) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:01.623030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b5d7f-0fa2-49f9-a99b-6bd1225c6263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:01.624459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b5d7f-0fa2-49f9-a99b-6bd1225c6263 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:01.632073 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 626/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:45:01 2022] GET /identity/v3/role_assignments?user.id=6d9439b0577446f1ae9ff61a23df4143&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=4287d802f16f48e99bde5dad08836906 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:03.747487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d6c8-0c92-4d83-8704-21214f77ca00 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:03.748054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d6c8-0c92-4d83-8704-21214f77ca00 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:03.748054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d6c8-0c92-4d83-8704-21214f77ca00 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:03.749379 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 621/1247] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:45:03.755289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516e7c3-93fe-4e22-b330-c97734ab1823 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:03.755831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516e7c3-93fe-4e22-b330-c97734ab1823 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:03.755953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516e7c3-93fe-4e22-b330-c97734ab1823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:03.763135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:03.776601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8516e7c3-93fe-4e22-b330-c97734ab1823 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:45:03.777821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8516e7c3-93fe-4e22-b330-c97734ab1823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:45:03.842619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 627/1248] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:45:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:45:03.866666 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7d6c8-0c92-4d83-8704-21214f77ca00 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:03.884139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:03.970558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7d6c8-0c92-4d83-8704-21214f77ca00 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:04.004532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a6df-66c0-4ae9-927f-39ee37d131b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:04.005146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a6df-66c0-4ae9-927f-39ee37d131b2 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:04.005449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a6df-66c0-4ae9-927f-39ee37d131b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:04.005715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a6df-66c0-4ae9-927f-39ee37d131b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:04.015660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9a6df-66c0-4ae9-927f-39ee37d131b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-5ab9a6df-66c0-4ae9-927f-39ee37d131b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:45:04.020882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:04.022129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:04.023332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 622/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:04.028192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516e7c3-93fe-4e22-b330-c97734ab1823 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:04.130000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516e7c3-93fe-4e22-b330-c97734ab1823 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:04.160389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:04.165682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a55ee-32ad-4620-b018-1c5d3ac602ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:04.166288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a55ee-32ad-4620-b018-1c5d3ac602ca None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:04.166565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a55ee-32ad-4620-b018-1c5d3ac602ca None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:04.166838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a55ee-32ad-4620-b018-1c5d3ac602ca None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:04.167509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a55ee-32ad-4620-b018-1c5d3ac602ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:04.167809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a55ee-32ad-4620-b018-1c5d3ac602ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:04.169240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a55ee-32ad-4620-b018-1c5d3ac602ca None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:04.177452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 628/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:04.183400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a6df-66c0-4ae9-927f-39ee37d131b2 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:04.264671 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:04.287710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a6df-66c0-4ae9-927f-39ee37d131b2 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:04.320684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e76c85-b776-4fab-a784-213ab3fd9610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:04.321327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e76c85-b776-4fab-a784-213ab3fd9610 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:04.321602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e76c85-b776-4fab-a784-213ab3fd9610 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:04.321867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e76c85-b776-4fab-a784-213ab3fd9610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:04.332800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e76c85-b776-4fab-a784-213ab3fd9610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:04.334266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e76c85-b776-4fab-a784-213ab3fd9610 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-49e76c85-b776-4fab-a784-213ab3fd9610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:45:04.349554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:04.350570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:45:04.351524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:45:04.351524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:04.351524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:04.351524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 623/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:04.356835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a55ee-32ad-4620-b018-1c5d3ac602ca None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:04.462076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a55ee-32ad-4620-b018-1c5d3ac602ca None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:04.497547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c84106-a1c8-4fe0-be3f-6280e2dd3b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:04.498163 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c84106-a1c8-4fe0-be3f-6280e2dd3b2b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:04.498463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c84106-a1c8-4fe0-be3f-6280e2dd3b2b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:04.498712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c84106-a1c8-4fe0-be3f-6280e2dd3b2b None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:04.499353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c84106-a1c8-4fe0-be3f-6280e2dd3b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:04.499650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c84106-a1c8-4fe0-be3f-6280e2dd3b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:04.501017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c84106-a1c8-4fe0-be3f-6280e2dd3b2b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:04.513400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 629/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:04.519979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e76c85-b776-4fab-a784-213ab3fd9610 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:04.622623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e76c85-b776-4fab-a784-213ab3fd9610 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:04.649560 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:04.658070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186100e2-949a-4bf2-8fa4-9c6d5db4f639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:04.658689 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186100e2-949a-4bf2-8fa4-9c6d5db4f639 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:04.658962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186100e2-949a-4bf2-8fa4-9c6d5db4f639 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:04.659230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186100e2-949a-4bf2-8fa4-9c6d5db4f639 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:04.668099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186100e2-949a-4bf2-8fa4-9c6d5db4f639 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:04.669638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186100e2-949a-4bf2-8fa4-9c6d5db4f639 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-186100e2-949a-4bf2-8fa4-9c6d5db4f639 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:45:04.681203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:04.682810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:04.683997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 624/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:04.688367 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c84106-a1c8-4fe0-be3f-6280e2dd3b2b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:04.744861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:04.791121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c84106-a1c8-4fe0-be3f-6280e2dd3b2b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:04.827551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff952943-6fd8-4ffc-b265-ef763e215a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:04.828164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff952943-6fd8-4ffc-b265-ef763e215a6e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:04.828491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff952943-6fd8-4ffc-b265-ef763e215a6e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:04.828710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff952943-6fd8-4ffc-b265-ef763e215a6e None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:04.829521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff952943-6fd8-4ffc-b265-ef763e215a6e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:04.829780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff952943-6fd8-4ffc-b265-ef763e215a6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:04.831218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff952943-6fd8-4ffc-b265-ef763e215a6e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:04.851382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 630/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Aug 10 22:45:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:04.857378 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186100e2-949a-4bf2-8fa4-9c6d5db4f639 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:04.959516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186100e2-949a-4bf2-8fa4-9c6d5db4f639 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:04.994162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2eb0-9940-45c7-a7c2-ec12e2137e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:04.994751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2eb0-9940-45c7-a7c2-ec12e2137e09 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:04.995072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2eb0-9940-45c7-a7c2-ec12e2137e09 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:04.995353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca2eb0-9940-45c7-a7c2-ec12e2137e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:05.049725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:05.062162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2eb0-9940-45c7-a7c2-ec12e2137e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:05.063594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca2eb0-9940-45c7-a7c2-ec12e2137e09 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:05.168828 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 625/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:45:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:45:05.175755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff952943-6fd8-4ffc-b265-ef763e215a6e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:05.290052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff952943-6fd8-4ffc-b265-ef763e215a6e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:05.304276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:05.326260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d128-8147-47ef-881d-0d146a57f0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:05.326905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d128-8147-47ef-881d-0d146a57f0d9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:05.327180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d128-8147-47ef-881d-0d146a57f0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:05.327451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375d128-8147-47ef-881d-0d146a57f0d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:05.339461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375d128-8147-47ef-881d-0d146a57f0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:05.341509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375d128-8147-47ef-881d-0d146a57f0d9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-8375d128-8147-47ef-881d-0d146a57f0d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:45:05.358827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:05.360120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:45:05.361341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:45:05.361341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:05.361341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:05.361341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 631/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:05.365959 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2eb0-9940-45c7-a7c2-ec12e2137e09 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:05.473812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:05.486043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca2eb0-9940-45c7-a7c2-ec12e2137e09 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:05.521492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c31ee-f468-40c0-bab1-da05fa661810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:05.522094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c31ee-f468-40c0-bab1-da05fa661810 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:05.522374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c31ee-f468-40c0-bab1-da05fa661810 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:05.522642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c31ee-f468-40c0-bab1-da05fa661810 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:05.524000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c31ee-f468-40c0-bab1-da05fa661810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:05.524000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c31ee-f468-40c0-bab1-da05fa661810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:05.525182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c31ee-f468-40c0-bab1-da05fa661810 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:05.537752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 626/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:05.546135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d128-8147-47ef-881d-0d146a57f0d9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:05.647268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375d128-8147-47ef-881d-0d146a57f0d9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:05.687205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e73b2-0b8c-45b5-99b3-6aba90ed4c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:05.687856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e73b2-0b8c-45b5-99b3-6aba90ed4c38 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:05.688133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e73b2-0b8c-45b5-99b3-6aba90ed4c38 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:05.688402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e73b2-0b8c-45b5-99b3-6aba90ed4c38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:05.696519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e73b2-0b8c-45b5-99b3-6aba90ed4c38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:05.698012 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e73b2-0b8c-45b5-99b3-6aba90ed4c38 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-3c1e73b2-0b8c-45b5-99b3-6aba90ed4c38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:45:05.710194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:05.713605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:05.715952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:45:05.715952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:45:05.715952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:45:05.715952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:45:05.715952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:45:05.715952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:45:05.715952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:45:05.715952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:05.715952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 632/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:05.726062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c31ee-f468-40c0-bab1-da05fa661810 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:05.834984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c31ee-f468-40c0-bab1-da05fa661810 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:05.871695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a59b40-89de-4896-9ab8-873de10f3987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:05.872579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59b40-89de-4896-9ab8-873de10f3987 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:05.872579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59b40-89de-4896-9ab8-873de10f3987 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:05.872842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a59b40-89de-4896-9ab8-873de10f3987 None admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:05.873538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a59b40-89de-4896-9ab8-873de10f3987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:05.873842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a59b40-89de-4896-9ab8-873de10f3987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:05.875284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a59b40-89de-4896-9ab8-873de10f3987 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:05.888636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 627/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:05.895544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e73b2-0b8c-45b5-99b3-6aba90ed4c38 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:05.921724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:06.005151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e73b2-0b8c-45b5-99b3-6aba90ed4c38 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:06.045671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815e687-3640-461e-9ca2-3c7c461352b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:06.046276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815e687-3640-461e-9ca2-3c7c461352b3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:06.046551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815e687-3640-461e-9ca2-3c7c461352b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:06.046817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815e687-3640-461e-9ca2-3c7c461352b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:06.047549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815e687-3640-461e-9ca2-3c7c461352b3 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=6d9439b0577446f1ae9ff61a23df4143) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:06.047851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815e687-3640-461e-9ca2-3c7c461352b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:06.049438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815e687-3640-461e-9ca2-3c7c461352b3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:06.055715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 633/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:45:05 2022] GET /identity/v3/role_assignments?user.id=6d9439b0577446f1ae9ff61a23df4143&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=edba0d8c079245a38a321d2d77d25419 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:45:08.095296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5c88-b017-4d63-ba89-1ce9a0067d52 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:08.095840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5c88-b017-4d63-ba89-1ce9a0067d52 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:08.095840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d5c88-b017-4d63-ba89-1ce9a0067d52 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:08.098055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 628/1261] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:45:08.103372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34eaea-6e89-4ecf-88a7-aad804f63bff None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:08.103825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34eaea-6e89-4ecf-88a7-aad804f63bff None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:08.103924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34eaea-6e89-4ecf-88a7-aad804f63bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:08.126226 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cd34eaea-6e89-4ecf-88a7-aad804f63bff None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:45:08.128255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cd34eaea-6e89-4ecf-88a7-aad804f63bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:45:08.197158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 634/1262] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:45:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:45:08.219706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5c88-b017-4d63-ba89-1ce9a0067d52 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:08.231746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:08.328840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d5c88-b017-4d63-ba89-1ce9a0067d52 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:08.364442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fb644-0256-4473-a866-8b6695d76c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:08.364980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fb644-0256-4473-a866-8b6695d76c30 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:08.365248 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fb644-0256-4473-a866-8b6695d76c30 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:08.365540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fb644-0256-4473-a866-8b6695d76c30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:08.375914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fb644-0256-4473-a866-8b6695d76c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-e58fb644-0256-4473-a866-8b6695d76c30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:45:08.380570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:08.381735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:08.382724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 629/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:45:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:08.388689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34eaea-6e89-4ecf-88a7-aad804f63bff None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:08.407860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:08.491466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34eaea-6e89-4ecf-88a7-aad804f63bff None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:08.527571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585da7f6-28a7-4da5-b787-74ce7b606981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:08.528165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da7f6-28a7-4da5-b787-74ce7b606981 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:08.528444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da7f6-28a7-4da5-b787-74ce7b606981 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:08.528707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da7f6-28a7-4da5-b787-74ce7b606981 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:08.529389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585da7f6-28a7-4da5-b787-74ce7b606981 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:08.531850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585da7f6-28a7-4da5-b787-74ce7b606981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:08.531850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585da7f6-28a7-4da5-b787-74ce7b606981 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:08.539885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 635/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:45:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:08.546685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fb644-0256-4473-a866-8b6695d76c30 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:08.615324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:08.649591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fb644-0256-4473-a866-8b6695d76c30 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:08.682951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cdb06-4cb1-412d-953d-8da2a7603a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:08.683573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cdb06-4cb1-412d-953d-8da2a7603a88 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:08.683841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cdb06-4cb1-412d-953d-8da2a7603a88 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:08.684111 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cdb06-4cb1-412d-953d-8da2a7603a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:08.694972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cdb06-4cb1-412d-953d-8da2a7603a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:08.696418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cdb06-4cb1-412d-953d-8da2a7603a88 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-d65cdb06-4cb1-412d-953d-8da2a7603a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:45:08.710808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:08.711862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:45:08.712765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:45:08.712765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:08.712765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:08.712765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 630/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:08.718120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585da7f6-28a7-4da5-b787-74ce7b606981 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:08.803471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:08.822748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585da7f6-28a7-4da5-b787-74ce7b606981 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:08.855540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1833813-c1d0-4e67-927d-d82563c2c49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:08.859891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1833813-c1d0-4e67-927d-d82563c2c49a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:08.859891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1833813-c1d0-4e67-927d-d82563c2c49a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:08.859891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1833813-c1d0-4e67-927d-d82563c2c49a None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:08.859891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1833813-c1d0-4e67-927d-d82563c2c49a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:08.859891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1833813-c1d0-4e67-927d-d82563c2c49a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:08.859891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1833813-c1d0-4e67-927d-d82563c2c49a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:08.871090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 636/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:08.876803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cdb06-4cb1-412d-953d-8da2a7603a88 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:09.015775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cdb06-4cb1-412d-953d-8da2a7603a88 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:09.040568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:09.059132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240cb31-a6d2-4173-a387-041f39f1fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:09.059815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240cb31-a6d2-4173-a387-041f39f1fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:09.060119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240cb31-a6d2-4173-a387-041f39f1fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:09.060415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240cb31-a6d2-4173-a387-041f39f1fdb8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:09.069376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240cb31-a6d2-4173-a387-041f39f1fdb8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:09.070877 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240cb31-a6d2-4173-a387-041f39f1fdb8 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-e240cb31-a6d2-4173-a387-041f39f1fdb8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:45:09.082749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:09.083904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:09.084850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 631/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:09.089904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1833813-c1d0-4e67-927d-d82563c2c49a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:09.193745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1833813-c1d0-4e67-927d-d82563c2c49a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:09.230648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741565-d391-490f-a4af-883bae3579dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:09.231255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741565-d391-490f-a4af-883bae3579dd None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:09.231532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741565-d391-490f-a4af-883bae3579dd None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:09.231800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741565-d391-490f-a4af-883bae3579dd None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:09.232522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a741565-d391-490f-a4af-883bae3579dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:09.232825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a741565-d391-490f-a4af-883bae3579dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:09.234278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a741565-d391-490f-a4af-883bae3579dd None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:09.243943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:09.252522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 637/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Aug 10 22:45:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:09.259378 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240cb31-a6d2-4173-a387-041f39f1fdb8 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:09.361571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240cb31-a6d2-4173-a387-041f39f1fdb8 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:09.403355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02683057-da41-4845-8c8a-8eff4aa3173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:09.403989 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02683057-da41-4845-8c8a-8eff4aa3173b None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:09.404266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02683057-da41-4845-8c8a-8eff4aa3173b None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:09.404535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02683057-da41-4845-8c8a-8eff4aa3173b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:09.416281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02683057-da41-4845-8c8a-8eff4aa3173b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:09.417789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02683057-da41-4845-8c8a-8eff4aa3173b None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-02683057-da41-4845-8c8a-8eff4aa3173b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:45:09.432755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:09.434622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:45:09.436120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:45:09.436120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:09.436120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:09.436120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 632/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:09.440015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741565-d391-490f-a4af-883bae3579dd None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:09.556464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741565-d391-490f-a4af-883bae3579dd None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:09.591724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915bc6f-2c1d-4f95-85ab-7d971e44c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:09.592342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bc6f-2c1d-4f95-85ab-7d971e44c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:09.592668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bc6f-2c1d-4f95-85ab-7d971e44c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:09.593424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915bc6f-2c1d-4f95-85ab-7d971e44c9a7 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:09.593555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915bc6f-2c1d-4f95-85ab-7d971e44c9a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:09.593856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915bc6f-2c1d-4f95-85ab-7d971e44c9a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:09.595227 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915bc6f-2c1d-4f95-85ab-7d971e44c9a7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:09.608173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 638/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 22:45:09.614700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02683057-da41-4845-8c8a-8eff4aa3173b None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:09.646036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:09.715006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02683057-da41-4845-8c8a-8eff4aa3173b None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:09.751565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4903bb1-cbaf-403d-80fb-d29323375aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:09.752197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4903bb1-cbaf-403d-80fb-d29323375aa3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:09.752479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4903bb1-cbaf-403d-80fb-d29323375aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:09.752750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4903bb1-cbaf-403d-80fb-d29323375aa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:09.759849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4903bb1-cbaf-403d-80fb-d29323375aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:09.761310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4903bb1-cbaf-403d-80fb-d29323375aa3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-f4903bb1-cbaf-403d-80fb-d29323375aa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:45:09.774850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:09.776713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:09.778476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:45:09.778476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:45:09.778476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:45:09.778476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:45:09.778476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:45:09.778476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:45:09.778476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:45:09.778476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:09.778476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 633/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:09.783255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915bc6f-2c1d-4f95-85ab-7d971e44c9a7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:09.849967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:09.892622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915bc6f-2c1d-4f95-85ab-7d971e44c9a7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:09.929937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d2ffc-8786-4112-94ed-5302dd03bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:09.930554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d2ffc-8786-4112-94ed-5302dd03bd72 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:09.930828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d2ffc-8786-4112-94ed-5302dd03bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:09.931097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d2ffc-8786-4112-94ed-5302dd03bd72 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:09.931799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d2ffc-8786-4112-94ed-5302dd03bd72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:09.932099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d2ffc-8786-4112-94ed-5302dd03bd72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:09.933564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d2ffc-8786-4112-94ed-5302dd03bd72 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:09.946785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 639/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:09.952995 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4903bb1-cbaf-403d-80fb-d29323375aa3 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:10.044337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:10.053597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4903bb1-cbaf-403d-80fb-d29323375aa3 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:10.086881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8f083-04ca-4c3f-b90a-bdc1f247bf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:10.087524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8f083-04ca-4c3f-b90a-bdc1f247bf47 None admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:10.087809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8f083-04ca-4c3f-b90a-bdc1f247bf47 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:10.088062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8f083-04ca-4c3f-b90a-bdc1f247bf47 None admin] PATH_INFO: `/v3/projects/f235227ac853478b8621f61a6313a3e2/users/6d9439b0577446f1ae9ff61a23df4143/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:10.090075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8f083-04ca-4c3f-b90a-bdc1f247bf47 None admin] RBAC: Authorizing `identity:create_grant(project_id=f235227ac853478b8621f61a6313a3e2, user_id=6d9439b0577446f1ae9ff61a23df4143, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:10.094354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8f083-04ca-4c3f-b90a-bdc1f247bf47 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:10.182419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 634/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Wed Aug 10 22:45:09 2022] PUT /identity/v3/projects/f235227ac853478b8621f61a6313a3e2/users/6d9439b0577446f1ae9ff61a23df4143/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:45:12.224562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90051efe-2aaf-4835-8bdb-d864217dac6f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:12.225153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90051efe-2aaf-4835-8bdb-d864217dac6f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:12.225153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90051efe-2aaf-4835-8bdb-d864217dac6f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:12.226458 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 640/1274] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:45:12.232190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7d00d-82fa-4990-bdf4-28e7d048668e None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:12.232655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7d00d-82fa-4990-bdf4-28e7d048668e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:12.232796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7d00d-82fa-4990-bdf4-28e7d048668e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:12.255605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-90a7d00d-82fa-4990-bdf4-28e7d048668e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:45:12.256793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-90a7d00d-82fa-4990-bdf4-28e7d048668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:45:12.327958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 635/1275] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:45:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:45:12.351198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90051efe-2aaf-4835-8bdb-d864217dac6f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:12.453150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90051efe-2aaf-4835-8bdb-d864217dac6f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:12.469959 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:12.487160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8be3e-89a4-4719-b8a7-91d8ed855aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:12.488292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8be3e-89a4-4719-b8a7-91d8ed855aa5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:12.488570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8be3e-89a4-4719-b8a7-91d8ed855aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:12.488839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8be3e-89a4-4719-b8a7-91d8ed855aa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:12.498630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8be3e-89a4-4719-b8a7-91d8ed855aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-95d8be3e-89a4-4719-b8a7-91d8ed855aa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 22:45:12.503291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:12.504401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:12.505690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 641/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Wed Aug 10 22:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:12.510516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7d00d-82fa-4990-bdf4-28e7d048668e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:12.594526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:12.614487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7d00d-82fa-4990-bdf4-28e7d048668e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:12.649096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb827eb-fd54-40c2-8bbf-83804c6b0d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:12.649773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb827eb-fd54-40c2-8bbf-83804c6b0d38 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:12.650045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb827eb-fd54-40c2-8bbf-83804c6b0d38 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:12.650313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb827eb-fd54-40c2-8bbf-83804c6b0d38 None admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:12.651001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb827eb-fd54-40c2-8bbf-83804c6b0d38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:12.651591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb827eb-fd54-40c2-8bbf-83804c6b0d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:12.653087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb827eb-fd54-40c2-8bbf-83804c6b0d38 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:12.663213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 636/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Wed Aug 10 22:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:12.669924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8be3e-89a4-4719-b8a7-91d8ed855aa5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:12.782992 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8be3e-89a4-4719-b8a7-91d8ed855aa5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:12.809676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53608ed0-26fa-4bd7-aeff-d7c38ae30d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:12.810309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53608ed0-26fa-4bd7-aeff-d7c38ae30d55 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:12.810562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53608ed0-26fa-4bd7-aeff-d7c38ae30d55 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:12.810826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53608ed0-26fa-4bd7-aeff-d7c38ae30d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:12.820998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53608ed0-26fa-4bd7-aeff-d7c38ae30d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:12.822499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53608ed0-26fa-4bd7-aeff-d7c38ae30d55 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-53608ed0-26fa-4bd7-aeff-d7c38ae30d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:45:12.836798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:12.838039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:45:12.839110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:45:12.839110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:12.839110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:12.839110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 642/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:12.843722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb827eb-fd54-40c2-8bbf-83804c6b0d38 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:12.942631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb827eb-fd54-40c2-8bbf-83804c6b0d38 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:12.976431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ee085-3075-4379-92d1-32e1cfca4048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:12.977027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ee085-3075-4379-92d1-32e1cfca4048 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:12.977322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ee085-3075-4379-92d1-32e1cfca4048 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:12.977601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ee085-3075-4379-92d1-32e1cfca4048 None admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:12.978227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ee085-3075-4379-92d1-32e1cfca4048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:12.978522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ee085-3075-4379-92d1-32e1cfca4048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:12.979864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ee085-3075-4379-92d1-32e1cfca4048 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:12.992278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 637/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:12.998167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53608ed0-26fa-4bd7-aeff-d7c38ae30d55 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:13.036496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:13.105188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53608ed0-26fa-4bd7-aeff-d7c38ae30d55 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:13.137172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e600-b5ae-4dec-a7ea-215c88f74131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:13.137433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e600-b5ae-4dec-a7ea-215c88f74131 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:13.137648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e600-b5ae-4dec-a7ea-215c88f74131 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:13.137912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e600-b5ae-4dec-a7ea-215c88f74131 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:13.145823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1e600-b5ae-4dec-a7ea-215c88f74131 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:13.147287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1e600-b5ae-4dec-a7ea-215c88f74131 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6ef1e600-b5ae-4dec-a7ea-215c88f74131 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 22:45:13.160471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:13.162936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:13.164094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 643/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:13.167900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ee085-3075-4379-92d1-32e1cfca4048 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:13.171794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:13.271183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ee085-3075-4379-92d1-32e1cfca4048 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:13.310574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9791ab0-b856-44f0-b158-1c1584f4ebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:13.311102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9791ab0-b856-44f0-b158-1c1584f4ebdc None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:13.311335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9791ab0-b856-44f0-b158-1c1584f4ebdc None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:13.311595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9791ab0-b856-44f0-b158-1c1584f4ebdc None admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:13.312321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9791ab0-b856-44f0-b158-1c1584f4ebdc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:13.312612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9791ab0-b856-44f0-b158-1c1584f4ebdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:13.314152 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9791ab0-b856-44f0-b158-1c1584f4ebdc None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:13.333191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 638/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Wed Aug 10 22:45:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:13.339244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e600-b5ae-4dec-a7ea-215c88f74131 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:13.437119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:13.447868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1e600-b5ae-4dec-a7ea-215c88f74131 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:13.482873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfe21e-107d-46b6-bff6-3b9bbd6322a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:13.483593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfe21e-107d-46b6-bff6-3b9bbd6322a5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:13.483954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfe21e-107d-46b6-bff6-3b9bbd6322a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:13.484540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfe21e-107d-46b6-bff6-3b9bbd6322a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:13.560422 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfe21e-107d-46b6-bff6-3b9bbd6322a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:13.571074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfe21e-107d-46b6-bff6-3b9bbd6322a5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:13.682220 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:13.693197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 644/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Wed Aug 10 22:45:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 22:45:13.699173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9791ab0-b856-44f0-b158-1c1584f4ebdc None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:13.763860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:13.805763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9791ab0-b856-44f0-b158-1c1584f4ebdc None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:13.843929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcedc5b-307a-4fad-8f02-f8f6e801ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:13.843929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcedc5b-307a-4fad-8f02-f8f6e801ea0e None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:13.843929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcedc5b-307a-4fad-8f02-f8f6e801ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:13.843929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcedc5b-307a-4fad-8f02-f8f6e801ea0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:13.851578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcedc5b-307a-4fad-8f02-f8f6e801ea0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:13.853001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcedc5b-307a-4fad-8f02-f8f6e801ea0e None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-adcedc5b-307a-4fad-8f02-f8f6e801ea0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 22:45:13.868282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:13.869533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 22:45:13.870701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 22:45:13.870701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 22:45:13.870701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:13.870701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 639/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:13.875901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfe21e-107d-46b6-bff6-3b9bbd6322a5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:14.003775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfe21e-107d-46b6-bff6-3b9bbd6322a5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:14.046605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3908d-b49c-458f-bc27-521b585b865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:14.047215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3908d-b49c-458f-bc27-521b585b865c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:14.047486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3908d-b49c-458f-bc27-521b585b865c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:14.047749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3908d-b49c-458f-bc27-521b585b865c None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:14.048535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3908d-b49c-458f-bc27-521b585b865c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:14.048832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3908d-b49c-458f-bc27-521b585b865c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:14.050825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3908d-b49c-458f-bc27-521b585b865c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:14.065369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 645/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Wed Aug 10 22:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:14.071438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcedc5b-307a-4fad-8f02-f8f6e801ea0e None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:14.187963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcedc5b-307a-4fad-8f02-f8f6e801ea0e None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:14.206084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:14.229155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69530f-b03c-4d0d-a617-a2028484574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:14.229828 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69530f-b03c-4d0d-a617-a2028484574a None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:14.230106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69530f-b03c-4d0d-a617-a2028484574a None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:14.230425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69530f-b03c-4d0d-a617-a2028484574a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:14.238861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69530f-b03c-4d0d-a617-a2028484574a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:14.240419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69530f-b03c-4d0d-a617-a2028484574a None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application [None req-2f69530f-b03c-4d0d-a617-a2028484574a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 22:45:14.252573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:14.253864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:14.255118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 22:45:14.255118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 22:45:14.255118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 22:45:14.255118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 22:45:14.255118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 22:45:14.255118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 22:45:14.255118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 22:45:14.255118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: ERROR keystone.server.flask.application Aug 10 22:45:14.255118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 640/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Wed Aug 10 22:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:14.263057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3908d-b49c-458f-bc27-521b585b865c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:14.327910 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:14.380588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3908d-b49c-458f-bc27-521b585b865c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:14.414695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8679f-2b34-4757-9a86-5445fca724f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:14.415318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8679f-2b34-4757-9a86-5445fca724f6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:14.415589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8679f-2b34-4757-9a86-5445fca724f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:14.415856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8679f-2b34-4757-9a86-5445fca724f6 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:14.416531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8679f-2b34-4757-9a86-5445fca724f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:14.416829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8679f-2b34-4757-9a86-5445fca724f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:14.418281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8679f-2b34-4757-9a86-5445fca724f6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:14.430384 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 646/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Wed Aug 10 22:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:14.436511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69530f-b03c-4d0d-a617-a2028484574a None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:14.541917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69530f-b03c-4d0d-a617-a2028484574a None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:14.578878 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872a4c6-60fa-4ed6-83cd-4755c63297f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:14.579480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a4c6-60fa-4ed6-83cd-4755c63297f5 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:14.579754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a4c6-60fa-4ed6-83cd-4755c63297f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:14.580014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a4c6-60fa-4ed6-83cd-4755c63297f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:14.580743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a4c6-60fa-4ed6-83cd-4755c63297f5 None admin] RBAC: Adding query filter params (role.id=edba0d8c079245a38a321d2d77d25419, scope.project.id=f235227ac853478b8621f61a6313a3e2, user.id=6d9439b0577446f1ae9ff61a23df4143) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:14.581041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a4c6-60fa-4ed6-83cd-4755c63297f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:14.582628 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a4c6-60fa-4ed6-83cd-4755c63297f5 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:14.589847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 641/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Wed Aug 10 22:45:14 2022] GET /identity/v3/role_assignments?user.id=6d9439b0577446f1ae9ff61a23df4143&scope.project.id=f235227ac853478b8621f61a6313a3e2&role.id=edba0d8c079245a38a321d2d77d25419 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:16.639035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9199-13b7-4540-afb9-0d41c39f40d5 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:16.639614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9199-13b7-4540-afb9-0d41c39f40d5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:16.639831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa9199-13b7-4540-afb9-0d41c39f40d5 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:16.641384 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 647/1288] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:45:16.648203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e01462-6c52-491f-aba7-274cd3266ab1 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:16.648798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e01462-6c52-491f-aba7-274cd3266ab1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:16.648933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e01462-6c52-491f-aba7-274cd3266ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:16.667502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b4e01462-6c52-491f-aba7-274cd3266ab1 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:45:16.668701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b4e01462-6c52-491f-aba7-274cd3266ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:45:16.701096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:16.738273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 642/1289] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:45:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:45:16.761523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa9199-13b7-4540-afb9-0d41c39f40d5 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:16.870558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa9199-13b7-4540-afb9-0d41c39f40d5 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:16.882160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:16.905408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7a959-934b-48f1-9d94-9fe55246031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:16.906031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7a959-934b-48f1-9d94-9fe55246031e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:16.906300 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7a959-934b-48f1-9d94-9fe55246031e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:16.906567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7a959-934b-48f1-9d94-9fe55246031e None admin] PATH_INFO: `/v3/services/placement` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:16.907132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7a959-934b-48f1-9d94-9fe55246031e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:16.908476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7a959-934b-48f1-9d94-9fe55246031e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-54c7a959-934b-48f1-9d94-9fe55246031e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:16.917158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:16.921876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:16.922972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 648/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Aug 10 22:45:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:16.925165 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e01462-6c52-491f-aba7-274cd3266ab1 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:17.039756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e01462-6c52-491f-aba7-274cd3266ab1 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:17.075542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9404a-25b9-44d1-8150-c4fb036e1b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:17.076206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9404a-25b9-44d1-8150-c4fb036e1b28 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:17.076479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9404a-25b9-44d1-8150-c4fb036e1b28 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:17.076747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9404a-25b9-44d1-8150-c4fb036e1b28 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:17.077412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9404a-25b9-44d1-8150-c4fb036e1b28 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:17.081650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9404a-25b9-44d1-8150-c4fb036e1b28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:17.081650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9404a-25b9-44d1-8150-c4fb036e1b28 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:17.084115 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 643/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Wed Aug 10 22:45:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:17.089942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7a959-934b-48f1-9d94-9fe55246031e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:17.193191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7a959-934b-48f1-9d94-9fe55246031e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:17.228937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc80dbc-00de-40bf-9d88-0b83fbfd6e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:17.229742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80dbc-00de-40bf-9d88-0b83fbfd6e12 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:17.230055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80dbc-00de-40bf-9d88-0b83fbfd6e12 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:17.230332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc80dbc-00de-40bf-9d88-0b83fbfd6e12 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:17.230990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc80dbc-00de-40bf-9d88-0b83fbfd6e12 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:17.231289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc80dbc-00de-40bf-9d88-0b83fbfd6e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:17.232694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc80dbc-00de-40bf-9d88-0b83fbfd6e12 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:17.238641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 649/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Wed Aug 10 22:45:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:19.226996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e852f-b53b-4954-82de-630b196ea6e7 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:19.227528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e852f-b53b-4954-82de-630b196ea6e7 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:19.227528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e852f-b53b-4954-82de-630b196ea6e7 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:19.228850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 644/1293] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:45:19.233911 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a83f6e-2477-45c7-9e0f-3ab6d752f1ac None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:19.234334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a83f6e-2477-45c7-9e0f-3ab6d752f1ac None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:19.234453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a83f6e-2477-45c7-9e0f-3ab6d752f1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:19.251866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b1a83f6e-2477-45c7-9e0f-3ab6d752f1ac None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:45:19.253045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b1a83f6e-2477-45c7-9e0f-3ab6d752f1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:45:19.282108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:19.318321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 650/1294] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:45:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:45:19.341306 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e852f-b53b-4954-82de-630b196ea6e7 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:19.372718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:19.441319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e852f-b53b-4954-82de-630b196ea6e7 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:19.474755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b7780-30b6-4b33-9fb7-8c8c5f20765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:19.475339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b7780-30b6-4b33-9fb7-8c8c5f20765f None admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:19.475634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b7780-30b6-4b33-9fb7-8c8c5f20765f None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:19.475898 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b7780-30b6-4b33-9fb7-8c8c5f20765f None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:19.476531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b7780-30b6-4b33-9fb7-8c8c5f20765f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:19.477947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b7780-30b6-4b33-9fb7-8c8c5f20765f None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:19.582697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 645/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Wed Aug 10 22:45:19 2022] POST /identity/v3/services => generated 246 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:45:21.581202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95627d02-79c0-42f1-a3a8-00ece32aecbe None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:21.581734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95627d02-79c0-42f1-a3a8-00ece32aecbe None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:21.581845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95627d02-79c0-42f1-a3a8-00ece32aecbe None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:21.583084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 651/1296] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:45:21.588158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c65ce-b30e-48f8-ada8-97aa79d96c4c None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:21.588593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c65ce-b30e-48f8-ada8-97aa79d96c4c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:21.588719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c65ce-b30e-48f8-ada8-97aa79d96c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:21.607426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-1a7c65ce-b30e-48f8-ada8-97aa79d96c4c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:45:21.609521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1a7c65ce-b30e-48f8-ada8-97aa79d96c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:45:21.679872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 646/1297] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:45:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:45:21.702308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95627d02-79c0-42f1-a3a8-00ece32aecbe None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:21.807492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95627d02-79c0-42f1-a3a8-00ece32aecbe None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:21.841673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0cf8-86d7-4886-9edf-1f5d95eef478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:21.842277 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0cf8-86d7-4886-9edf-1f5d95eef478 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:21.842550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0cf8-86d7-4886-9edf-1f5d95eef478 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:21.842815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0cf8-86d7-4886-9edf-1f5d95eef478 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:21.843390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb0cf8-86d7-4886-9edf-1f5d95eef478 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:21.844741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb0cf8-86d7-4886-9edf-1f5d95eef478 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-53eb0cf8-86d7-4886-9edf-1f5d95eef478 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:21.854961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:21.856459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:21.857549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 652/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Aug 10 22:45:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:21.866043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c65ce-b30e-48f8-ada8-97aa79d96c4c None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:21.885418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:21.965306 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c65ce-b30e-48f8-ada8-97aa79d96c4c None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:22.003162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d507d-0010-46eb-9f14-91b0fb32b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:22.003769 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d507d-0010-46eb-9f14-91b0fb32b816 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:22.004057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d507d-0010-46eb-9f14-91b0fb32b816 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:22.004322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d507d-0010-46eb-9f14-91b0fb32b816 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:22.004955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d507d-0010-46eb-9f14-91b0fb32b816 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:22.005246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d507d-0010-46eb-9f14-91b0fb32b816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:22.006619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d507d-0010-46eb-9f14-91b0fb32b816 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:22.011886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 647/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Wed Aug 10 22:45:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:22.018559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0cf8-86d7-4886-9edf-1f5d95eef478 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:22.049176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:22.115413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0cf8-86d7-4886-9edf-1f5d95eef478 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:22.150122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e991bf2-34f5-4a5f-9c04-96ebe203f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:22.150721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991bf2-34f5-4a5f-9c04-96ebe203f627 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:22.150993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991bf2-34f5-4a5f-9c04-96ebe203f627 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:22.151257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e991bf2-34f5-4a5f-9c04-96ebe203f627 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:22.151950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e991bf2-34f5-4a5f-9c04-96ebe203f627 None admin] RBAC: Adding query filter params (interface=public, service_id=256ff5c7fbb3476f9a37076cf42a8b73, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:22.152247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e991bf2-34f5-4a5f-9c04-96ebe203f627 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:22.153619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e991bf2-34f5-4a5f-9c04-96ebe203f627 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:22.159262 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 653/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Wed Aug 10 22:45:22 2022] GET /identity/v3/endpoints?service_id=256ff5c7fbb3476f9a37076cf42a8b73&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:22.164455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d507d-0010-46eb-9f14-91b0fb32b816 None admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:22.245197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:22.263073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d507d-0010-46eb-9f14-91b0fb32b816 None admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:22.295194 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6226b1-a044-4297-bc16-d043f91906ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:22.295791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6226b1-a044-4297-bc16-d043f91906ce None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:22.296064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6226b1-a044-4297-bc16-d043f91906ce None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:22.296331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6226b1-a044-4297-bc16-d043f91906ce None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:22.296923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6226b1-a044-4297-bc16-d043f91906ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:22.298299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6226b1-a044-4297-bc16-d043f91906ce None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:22.306133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 648/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Wed Aug 10 22:45:22 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 22:45:24.319504 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe77a84-6bce-47e7-8100-152f53b2f2c8 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:24.320087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe77a84-6bce-47e7-8100-152f53b2f2c8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:24.320087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe77a84-6bce-47e7-8100-152f53b2f2c8 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:24.321429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 654/1302] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:45:24.327141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b44b8-2315-4f7a-b177-54c9b94f0905 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:24.327662 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b44b8-2315-4f7a-b177-54c9b94f0905 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:24.327662 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b44b8-2315-4f7a-b177-54c9b94f0905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:24.347389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-2e9b44b8-2315-4f7a-b177-54c9b94f0905 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:45:24.348669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2e9b44b8-2315-4f7a-b177-54c9b94f0905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:45:24.420236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 649/1303] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:45:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 22:45:24.443047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe77a84-6bce-47e7-8100-152f53b2f2c8 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:24.552649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:24.559574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe77a84-6bce-47e7-8100-152f53b2f2c8 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:24.593470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898a1ad-a798-4d8c-b34a-d4ce9f383693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:24.594017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898a1ad-a798-4d8c-b34a-d4ce9f383693 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:24.594290 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898a1ad-a798-4d8c-b34a-d4ce9f383693 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:24.594555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898a1ad-a798-4d8c-b34a-d4ce9f383693 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:24.595119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898a1ad-a798-4d8c-b34a-d4ce9f383693 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:24.597336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898a1ad-a798-4d8c-b34a-d4ce9f383693 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-e898a1ad-a798-4d8c-b34a-d4ce9f383693 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 22:45:24.605870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 22:45:24.607042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 22:45:24.608008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Aug 10 22:45:24.609452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 655/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Wed Aug 10 22:45:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 22:45:24.613062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b44b8-2315-4f7a-b177-54c9b94f0905 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:24.690119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:24.712522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b44b8-2315-4f7a-b177-54c9b94f0905 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:24.745496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455cbdf-ca63-4b8c-bc88-05a36e70f5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:24.746129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455cbdf-ca63-4b8c-bc88-05a36e70f5a3 None admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:24.746399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455cbdf-ca63-4b8c-bc88-05a36e70f5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:24.746659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455cbdf-ca63-4b8c-bc88-05a36e70f5a3 None admin] PATH_INFO: `/v3/services` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:24.747268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455cbdf-ca63-4b8c-bc88-05a36e70f5a3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:45:24.747558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455cbdf-ca63-4b8c-bc88-05a36e70f5a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:24.748919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455cbdf-ca63-4b8c-bc88-05a36e70f5a3 None admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:24.754164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 650/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Wed Aug 10 22:45:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:45:24.759962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898a1ad-a798-4d8c-b34a-d4ce9f383693 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:45:24.861864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898a1ad-a798-4d8c-b34a-d4ce9f383693 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:45:24.895118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fb4ca-cad5-4a69-935c-7e8d1abf4cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:45:24.895711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb4ca-cad5-4a69-935c-7e8d1abf4cc0 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:45:24.895986 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb4ca-cad5-4a69-935c-7e8d1abf4cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:45:24.896255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fb4ca-cad5-4a69-935c-7e8d1abf4cc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:45:24.896913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fb4ca-cad5-4a69-935c-7e8d1abf4cc0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:45:24.898291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fb4ca-cad5-4a69-935c-7e8d1abf4cc0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:45:24.970454 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 656/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 22:45:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 22:45:34.764612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=30 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:45:34.965527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:13.577129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a4c82-efa7-4da3-a127-ac0b0e0280d1 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:13.577750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a4c82-efa7-4da3-a127-ac0b0e0280d1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:13.577750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a4c82-efa7-4da3-a127-ac0b0e0280d1 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:13.584575 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01fd6e-ad5d-4ccd-993a-6b63fa5fa6ea None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:13.585117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01fd6e-ad5d-4ccd-993a-6b63fa5fa6ea None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:13.585117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01fd6e-ad5d-4ccd-993a-6b63fa5fa6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:13.588602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 651/1307] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:13.666320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ad01fd6e-ad5d-4ccd-993a-6b63fa5fa6ea None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:13.667522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ad01fd6e-ad5d-4ccd-993a-6b63fa5fa6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:13.801779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 657/1308] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:52:13.838216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7b57e-164b-4691-9b50-41bb9c78a26d None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:13.838544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7b57e-164b-4691-9b50-41bb9c78a26d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:13.838763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7b57e-164b-4691-9b50-41bb9c78a26d None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:13.840103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 652/1309] 10.222.0.77 () {54 vars in 965 bytes} [Wed Aug 10 22:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:13.846929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f91b94-b1b0-4313-8c26-975a802e7cc0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:13.847214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f91b94-b1b0-4313-8c26-975a802e7cc0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:13.847489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f91b94-b1b0-4313-8c26-975a802e7cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:13.930413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-16f91b94-b1b0-4313-8c26-975a802e7cc0 None None] MFA Rules not processed for user `ff5c08bfc5e94b65bd4addde267e4598`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:13.932177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-16f91b94-b1b0-4313-8c26-975a802e7cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:13.954139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:14.024778 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7b57e-164b-4691-9b50-41bb9c78a26d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:14.026731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-48b7b57e-164b-4691-9b50-41bb9c78a26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:14.035779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 658/1310] 10.222.0.77 () {58 vars in 1062 bytes} [Wed Aug 10 22:52:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:52:14.163766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7b57e-164b-4691-9b50-41bb9c78a26d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:14.243017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96f06b-7794-4c9a-bf46-7676b6e8ad8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:14.244415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96f06b-7794-4c9a-bf46-7676b6e8ad8c service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:14.244840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96f06b-7794-4c9a-bf46-7676b6e8ad8c service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:14.245278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96f06b-7794-4c9a-bf46-7676b6e8ad8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:14.247084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-db96f06b-7794-4c9a-bf46-7676b6e8ad8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:14.304828 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:14.361081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96f06b-7794-4c9a-bf46-7676b6e8ad8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:14.362763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96f06b-7794-4c9a-bf46-7676b6e8ad8c service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:14.401794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 653/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 22:52:16.738454 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff857a6-8daa-4b0b-8666-6b843b333256 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:16.739208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff857a6-8daa-4b0b-8666-6b843b333256 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:16.739208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff857a6-8daa-4b0b-8666-6b843b333256 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:16.740338 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 659/1312] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:16.746629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed99d3a-0379-4b20-91fb-39753067d48c None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:16.747165 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed99d3a-0379-4b20-91fb-39753067d48c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:16.748253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed99d3a-0379-4b20-91fb-39753067d48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:16.836021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-4ed99d3a-0379-4b20-91fb-39753067d48c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:16.837270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4ed99d3a-0379-4b20-91fb-39753067d48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:16.935859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 654/1313] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:16.974797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff857a6-8daa-4b0b-8666-6b843b333256 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:16.976400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eff857a6-8daa-4b0b-8666-6b843b333256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:17.084794 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff857a6-8daa-4b0b-8666-6b843b333256 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:17.162376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:17.166155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1850028-73f4-4ea4-8303-b69628b5d0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:17.166781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1850028-73f4-4ea4-8303-b69628b5d0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:17.167057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1850028-73f4-4ea4-8303-b69628b5d0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:17.167326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1850028-73f4-4ea4-8303-b69628b5d0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:17.169148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f1850028-73f4-4ea4-8303-b69628b5d0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:17.295643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1850028-73f4-4ea4-8303-b69628b5d0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:17.297080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1850028-73f4-4ea4-8303-b69628b5d0d0 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:17.316641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 660/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:52:19.971835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a1f7-fea3-42c3-b156-a02772ab37ad None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:19.972346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a1f7-fea3-42c3-b156-a02772ab37ad None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:19.972346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5a1f7-fea3-42c3-b156-a02772ab37ad None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:19.973680 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 655/1315] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:19.979516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831d69a-60c7-47de-b556-2bd5129e24f9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:19.979958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831d69a-60c7-47de-b556-2bd5129e24f9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:19.980071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831d69a-60c7-47de-b556-2bd5129e24f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:20.044580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1831d69a-60c7-47de-b556-2bd5129e24f9 None None] MFA Rules not processed for user `3dd759a8e1e24b9baa56f4a701f83e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:20.045797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1831d69a-60c7-47de-b556-2bd5129e24f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:20.095710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:20.139482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 661/1316] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:20.178864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5a1f7-fea3-42c3-b156-a02772ab37ad None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:20.180393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c3c5a1f7-fea3-42c3-b156-a02772ab37ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:20.190622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:20.284638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5a1f7-fea3-42c3-b156-a02772ab37ad None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:20.355975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf41bb-1f77-4d26-aeed-4205ab92c7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:20.356563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf41bb-1f77-4d26-aeed-4205ab92c7dd service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:20.356837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf41bb-1f77-4d26-aeed-4205ab92c7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:20.357103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf41bb-1f77-4d26-aeed-4205ab92c7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:20.358718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bcbf41bb-1f77-4d26-aeed-4205ab92c7dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:20.419176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:20.464625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf41bb-1f77-4d26-aeed-4205ab92c7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:20.466070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf41bb-1f77-4d26-aeed-4205ab92c7dd service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:20.484134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 656/1317] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:52:23.297004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358ed18-fc7e-4927-b246-dd97b206375d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:23.297688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358ed18-fc7e-4927-b246-dd97b206375d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:23.297688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358ed18-fc7e-4927-b246-dd97b206375d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:23.298961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 662/1318] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:23.304039 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9373a-5039-4fb7-8ead-4e6f7f62cdd4 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:23.304481 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9373a-5039-4fb7-8ead-4e6f7f62cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:23.304587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9373a-5039-4fb7-8ead-4e6f7f62cdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:23.370596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c0c9373a-5039-4fb7-8ead-4e6f7f62cdd4 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:23.371805 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c0c9373a-5039-4fb7-8ead-4e6f7f62cdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:23.470521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 657/1319] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:23.508909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358ed18-fc7e-4927-b246-dd97b206375d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:23.510507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8358ed18-fc7e-4927-b246-dd97b206375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:23.614125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358ed18-fc7e-4927-b246-dd97b206375d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:23.685821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540813cc-7334-4370-b96e-0c60833ae81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:23.687169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540813cc-7334-4370-b96e-0c60833ae81f service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:23.687169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540813cc-7334-4370-b96e-0c60833ae81f service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:23.687169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540813cc-7334-4370-b96e-0c60833ae81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:23.688551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-540813cc-7334-4370-b96e-0c60833ae81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:23.696072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:23.799451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540813cc-7334-4370-b96e-0c60833ae81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:23.800807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540813cc-7334-4370-b96e-0c60833ae81f service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:23.818955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 663/1320] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:52:26.919543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ba7a8-eaff-42a2-9412-11fe45967920 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:26.920052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ba7a8-eaff-42a2-9412-11fe45967920 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:26.920052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ba7a8-eaff-42a2-9412-11fe45967920 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:26.921603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 658/1321] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:26.926723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b829c1c-ebba-46e6-ba73-cbc3e0434b96 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:26.927180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b829c1c-ebba-46e6-ba73-cbc3e0434b96 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:26.927274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b829c1c-ebba-46e6-ba73-cbc3e0434b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:26.993772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2b829c1c-ebba-46e6-ba73-cbc3e0434b96 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:26.994930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2b829c1c-ebba-46e6-ba73-cbc3e0434b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:27.051524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:27.089697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 664/1322] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:27.127903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ba7a8-eaff-42a2-9412-11fe45967920 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:27.129608 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-796ba7a8-eaff-42a2-9412-11fe45967920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:27.151707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:27.245840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ba7a8-eaff-42a2-9412-11fe45967920 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:27.324541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc640716-59c2-400d-8e6b-9156707a18af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:27.325154 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc640716-59c2-400d-8e6b-9156707a18af service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:27.325464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc640716-59c2-400d-8e6b-9156707a18af service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:27.325737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc640716-59c2-400d-8e6b-9156707a18af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:27.327443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bc640716-59c2-400d-8e6b-9156707a18af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:27.405060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:27.445340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc640716-59c2-400d-8e6b-9156707a18af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:27.447687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc640716-59c2-400d-8e6b-9156707a18af service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:27.466861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 659/1323] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:52:29.530124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaccf8-26e5-417a-99ae-c0fba0f694d1 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:29.530691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaccf8-26e5-417a-99ae-c0fba0f694d1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:29.530691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaccf8-26e5-417a-99ae-c0fba0f694d1 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:29.531975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 665/1324] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:29.537258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327860e-1c1e-47a0-9d1e-f1f68743e183 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:29.537736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327860e-1c1e-47a0-9d1e-f1f68743e183 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:29.537834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327860e-1c1e-47a0-9d1e-f1f68743e183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:29.608915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7327860e-1c1e-47a0-9d1e-f1f68743e183 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:29.610135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7327860e-1c1e-47a0-9d1e-f1f68743e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:29.710162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 660/1325] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:29.760199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069b21e-cb03-4af6-b1b0-21cd2c8db170 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:29.760586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069b21e-cb03-4af6-b1b0-21cd2c8db170 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:29.760920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069b21e-cb03-4af6-b1b0-21cd2c8db170 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:29.762378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 666/1326] 10.222.0.77 () {54 vars in 965 bytes} [Wed Aug 10 22:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:29.768252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d01b2-021e-4489-a65a-f31426c0af06 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:29.768536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d01b2-021e-4489-a65a-f31426c0af06 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:29.768806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d01b2-021e-4489-a65a-f31426c0af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:29.801900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:29.847346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-fa9d01b2-021e-4489-a65a-f31426c0af06 None None] MFA Rules not processed for user `ff5c08bfc5e94b65bd4addde267e4598`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:29.848546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fa9d01b2-021e-4489-a65a-f31426c0af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:29.925138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 661/1327] 10.222.0.77 () {58 vars in 1062 bytes} [Wed Aug 10 22:52:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:29.934721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069b21e-cb03-4af6-b1b0-21cd2c8db170 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:29.936436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d069b21e-cb03-4af6-b1b0-21cd2c8db170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:30.042608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069b21e-cb03-4af6-b1b0-21cd2c8db170 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:30.118643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2aedc-4689-443d-939a-630b492147db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:30.119268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2aedc-4689-443d-939a-630b492147db service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:30.119544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2aedc-4689-443d-939a-630b492147db service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:30.119812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2aedc-4689-443d-939a-630b492147db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:30.121553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5cf2aedc-4689-443d-939a-630b492147db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:30.142150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:30.236482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2aedc-4689-443d-939a-630b492147db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:30.237935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2aedc-4689-443d-939a-630b492147db service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:30.256601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 667/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:52:32.564935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76f6ab-eee1-45df-8eae-b2248baa4d21 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:32.565514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76f6ab-eee1-45df-8eae-b2248baa4d21 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:32.565514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76f6ab-eee1-45df-8eae-b2248baa4d21 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:32.566839 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 662/1329] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:32.572550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daa14f-af6d-462c-9ec2-b6a704e73341 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:32.572958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daa14f-af6d-462c-9ec2-b6a704e73341 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:32.573075 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daa14f-af6d-462c-9ec2-b6a704e73341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:32.640780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-88daa14f-af6d-462c-9ec2-b6a704e73341 None None] MFA Rules not processed for user `3dd759a8e1e24b9baa56f4a701f83e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:32.642001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-88daa14f-af6d-462c-9ec2-b6a704e73341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:32.706500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:32.740738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 668/1330] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:32.779337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76f6ab-eee1-45df-8eae-b2248baa4d21 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:32.780843 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3f76f6ab-eee1-45df-8eae-b2248baa4d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:32.883716 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76f6ab-eee1-45df-8eae-b2248baa4d21 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:32.909492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:32.977532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a1b94-3202-44d4-98eb-44be4502cf84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:32.978165 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1b94-3202-44d4-98eb-44be4502cf84 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:32.978442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1b94-3202-44d4-98eb-44be4502cf84 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:32.978706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a1b94-3202-44d4-98eb-44be4502cf84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:32.980314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d86a1b94-3202-44d4-98eb-44be4502cf84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:33.093815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a1b94-3202-44d4-98eb-44be4502cf84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:33.095245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a1b94-3202-44d4-98eb-44be4502cf84 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:33.113486 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 663/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:52:35.771874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930ae99-297b-4bf7-bae8-505b6476ffaa None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:35.771874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930ae99-297b-4bf7-bae8-505b6476ffaa None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:35.771874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930ae99-297b-4bf7-bae8-505b6476ffaa None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:35.771874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 669/1332] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:35.777208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1125c9d-405f-4890-b0b5-4fa051daad60 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:35.777691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1125c9d-405f-4890-b0b5-4fa051daad60 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:35.777786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1125c9d-405f-4890-b0b5-4fa051daad60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:35.842346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:35.844923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e1125c9d-405f-4890-b0b5-4fa051daad60 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:35.846420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e1125c9d-405f-4890-b0b5-4fa051daad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:35.941763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 664/1333] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:52:35.978364 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930ae99-297b-4bf7-bae8-505b6476ffaa None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:35.979926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3930ae99-297b-4bf7-bae8-505b6476ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:36.083498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930ae99-297b-4bf7-bae8-505b6476ffaa None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:36.156287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23ae0-7a7c-4278-a802-b62d0afeaba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:36.156794 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23ae0-7a7c-4278-a802-b62d0afeaba9 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:36.157068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23ae0-7a7c-4278-a802-b62d0afeaba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:36.157358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23ae0-7a7c-4278-a802-b62d0afeaba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:36.158991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-51c23ae0-7a7c-4278-a802-b62d0afeaba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:36.186296 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:36.268275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23ae0-7a7c-4278-a802-b62d0afeaba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:36.269730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23ae0-7a7c-4278-a802-b62d0afeaba9 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:36.287935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 670/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:52:38.330145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ad339-d590-47f5-9db9-360d8133b7dc None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:38.330685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ad339-d590-47f5-9db9-360d8133b7dc None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:38.330685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ad339-d590-47f5-9db9-360d8133b7dc None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:38.332021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 665/1335] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:38.337612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2bc4c-28b3-4075-9d0d-2b68483b866b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:38.338057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2bc4c-28b3-4075-9d0d-2b68483b866b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:38.338149 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2bc4c-28b3-4075-9d0d-2b68483b866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:38.402302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-0ab2bc4c-28b3-4075-9d0d-2b68483b866b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:38.403482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0ab2bc4c-28b3-4075-9d0d-2b68483b866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:38.477330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:38.500862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 671/1336] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:38.544736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ad339-d590-47f5-9db9-360d8133b7dc None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:38.547340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-575ad339-d590-47f5-9db9-360d8133b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:38.672370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ad339-d590-47f5-9db9-360d8133b7dc None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:38.699888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:38.745063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf075b-9fee-4758-8ba6-fa544dadbf6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:38.745695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf075b-9fee-4758-8ba6-fa544dadbf6a service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:38.745964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf075b-9fee-4758-8ba6-fa544dadbf6a service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:38.746230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf075b-9fee-4758-8ba6-fa544dadbf6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:38.747847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-29cf075b-9fee-4758-8ba6-fa544dadbf6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:38.853883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf075b-9fee-4758-8ba6-fa544dadbf6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:38.855531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf075b-9fee-4758-8ba6-fa544dadbf6a service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:38.873340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 666/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:52:41.653098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e289e-8cc3-4c8a-bd16-05ecd40c318d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:41.653665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e289e-8cc3-4c8a-bd16-05ecd40c318d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:41.653665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e289e-8cc3-4c8a-bd16-05ecd40c318d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:41.654981 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 672/1338] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:41.660021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938f7f-76fb-41e5-9f25-f898a96792a2 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:41.660451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938f7f-76fb-41e5-9f25-f898a96792a2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:41.660545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938f7f-76fb-41e5-9f25-f898a96792a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:41.726858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-38938f7f-76fb-41e5-9f25-f898a96792a2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:41.728584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-38938f7f-76fb-41e5-9f25-f898a96792a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:41.736854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:41.834736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 667/1339] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:41.872211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e289e-8cc3-4c8a-bd16-05ecd40c318d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:41.873807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-887e289e-8cc3-4c8a-bd16-05ecd40c318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:41.976786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e289e-8cc3-4c8a-bd16-05ecd40c318d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:42.049366 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a51ae3-4e09-41b3-bf69-e5675a8c2312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:42.049958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a51ae3-4e09-41b3-bf69-e5675a8c2312 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:42.050229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a51ae3-4e09-41b3-bf69-e5675a8c2312 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:42.050492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a51ae3-4e09-41b3-bf69-e5675a8c2312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:42.052091 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-05a51ae3-4e09-41b3-bf69-e5675a8c2312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:42.086637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:42.159686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a51ae3-4e09-41b3-bf69-e5675a8c2312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:42.161109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a51ae3-4e09-41b3-bf69-e5675a8c2312 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:42.179625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 673/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 22:52:46.455980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751170ad-9a39-44d2-93ac-9b8f64dfb173 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:46.456535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751170ad-9a39-44d2-93ac-9b8f64dfb173 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:46.456535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751170ad-9a39-44d2-93ac-9b8f64dfb173 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:46.458029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 668/1341] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:46.463662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f35e2f-5eab-4fe2-a710-8363601825c6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:46.464167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f35e2f-5eab-4fe2-a710-8363601825c6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:46.464281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f35e2f-5eab-4fe2-a710-8363601825c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:46.530274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b9f35e2f-5eab-4fe2-a710-8363601825c6 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:46.531478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b9f35e2f-5eab-4fe2-a710-8363601825c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:46.628453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:46.639622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 674/1342] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:46.681108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751170ad-9a39-44d2-93ac-9b8f64dfb173 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:46.682766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-751170ad-9a39-44d2-93ac-9b8f64dfb173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:46.794436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751170ad-9a39-44d2-93ac-9b8f64dfb173 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:46.834130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:46.873508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684b9f5-84d4-44e4-b7da-6da5d7b3d4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:46.874105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684b9f5-84d4-44e4-b7da-6da5d7b3d4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:46.874393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684b9f5-84d4-44e4-b7da-6da5d7b3d4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:46.874658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684b9f5-84d4-44e4-b7da-6da5d7b3d4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:46.876364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9684b9f5-84d4-44e4-b7da-6da5d7b3d4d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:46.990220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684b9f5-84d4-44e4-b7da-6da5d7b3d4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:46.991745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684b9f5-84d4-44e4-b7da-6da5d7b3d4d0 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:47.011682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 669/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 22:52:50.092786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7aa3f-9159-43a0-aeda-cebc946f86f7 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:50.093338 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7aa3f-9159-43a0-aeda-cebc946f86f7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:50.093338 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7aa3f-9159-43a0-aeda-cebc946f86f7 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:50.094681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 675/1344] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:50.100214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98f7d6-626b-4348-8fe5-9b26e83e63d8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:50.100645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98f7d6-626b-4348-8fe5-9b26e83e63d8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:50.100739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98f7d6-626b-4348-8fe5-9b26e83e63d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:50.166996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-6d98f7d6-626b-4348-8fe5-9b26e83e63d8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:50.168176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6d98f7d6-626b-4348-8fe5-9b26e83e63d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:50.186580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:50.264381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 670/1345] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:52:50.301869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7aa3f-9159-43a0-aeda-cebc946f86f7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:50.303394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a0a7aa3f-9159-43a0-aeda-cebc946f86f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:50.411368 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7aa3f-9159-43a0-aeda-cebc946f86f7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:50.484209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1aff-df4e-420b-a86b-573c90b65981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:50.484811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1aff-df4e-420b-a86b-573c90b65981 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:50.485112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1aff-df4e-420b-a86b-573c90b65981 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:50.485429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1aff-df4e-420b-a86b-573c90b65981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:50.487054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f04b1aff-df4e-420b-a86b-573c90b65981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:50.530611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:50.602759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1aff-df4e-420b-a86b-573c90b65981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:50.604188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1aff-df4e-420b-a86b-573c90b65981 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:50.622643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 676/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:52:55.006089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887d76-2326-41cd-9632-1cef7f7025c9 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:55.006690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887d76-2326-41cd-9632-1cef7f7025c9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:55.006690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887d76-2326-41cd-9632-1cef7f7025c9 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:55.008186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 671/1347] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:52:55.014763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea02786-5bfd-49f1-9414-5fbb6a33c54e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:55.015389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea02786-5bfd-49f1-9414-5fbb6a33c54e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:55.015591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea02786-5bfd-49f1-9414-5fbb6a33c54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:55.085887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fea02786-5bfd-49f1-9414-5fbb6a33c54e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:52:55.087305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fea02786-5bfd-49f1-9414-5fbb6a33c54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:55.189743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:55.193334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 677/1348] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:52:55.231486 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8887d76-2326-41cd-9632-1cef7f7025c9 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:52:55.233101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f8887d76-2326-41cd-9632-1cef7f7025c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:55.344313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8887d76-2326-41cd-9632-1cef7f7025c9 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:52:55.398605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:52:55.426366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea9ac6-eda8-4583-b3f9-54ea4c7c274e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:52:55.426974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9ac6-eda8-4583-b3f9-54ea4c7c274e service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:52:55.427243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9ac6-eda8-4583-b3f9-54ea4c7c274e service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:52:55.427507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9ac6-eda8-4583-b3f9-54ea4c7c274e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:52:55.429223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1eea9ac6-eda8-4583-b3f9-54ea4c7c274e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:52:55.542463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea9ac6-eda8-4583-b3f9-54ea4c7c274e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:52:55.543909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea9ac6-eda8-4583-b3f9-54ea4c7c274e service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:52:55.563910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 672/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:00.620991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94964689-cc07-4a7f-9fc7-c28178ac1b68 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:00.621466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94964689-cc07-4a7f-9fc7-c28178ac1b68 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:00.621561 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94964689-cc07-4a7f-9fc7-c28178ac1b68 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:00.623300 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 678/1350] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 22:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:00.628237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f8070-9909-40b5-8662-3396e3323682 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:00.628652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f8070-9909-40b5-8662-3396e3323682 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:00.628849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f8070-9909-40b5-8662-3396e3323682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:00.737742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-774f8070-9909-40b5-8662-3396e3323682 None None] MFA Rules not processed for user `6d9439b0577446f1ae9ff61a23df4143`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:00.739409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-774f8070-9909-40b5-8662-3396e3323682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:00.771365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:00.913872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 673/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 22:53:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:05.201272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29f182-7c53-4d52-8e84-15a3868be03c None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:05.201879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29f182-7c53-4d52-8e84-15a3868be03c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:05.201879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29f182-7c53-4d52-8e84-15a3868be03c None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:05.203160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 679/1352] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 22:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:05.208458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44f111-6083-4e0e-bf3b-3f1dda7ab627 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:05.208923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44f111-6083-4e0e-bf3b-3f1dda7ab627 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:05.209258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44f111-6083-4e0e-bf3b-3f1dda7ab627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:05.292293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-1d44f111-6083-4e0e-bf3b-3f1dda7ab627 None None] MFA Rules not processed for user `6d9439b0577446f1ae9ff61a23df4143`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:05.293505 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1d44f111-6083-4e0e-bf3b-3f1dda7ab627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:05.368514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:05.405744 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 674/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 22:53:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:06.774930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3faef3-3fa5-4748-9728-ab6c1b172491 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:06.775467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3faef3-3fa5-4748-9728-ab6c1b172491 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:06.775467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3faef3-3fa5-4748-9728-ab6c1b172491 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:06.777009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 680/1354] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 22:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:06.781971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28afbc3-b466-4029-9e3d-9b4abd8f6484 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:06.782408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28afbc3-b466-4029-9e3d-9b4abd8f6484 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:06.782642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28afbc3-b466-4029-9e3d-9b4abd8f6484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:06.860211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e28afbc3-b466-4029-9e3d-9b4abd8f6484 None None] MFA Rules not processed for user `6d9439b0577446f1ae9ff61a23df4143`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:06.861362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e28afbc3-b466-4029-9e3d-9b4abd8f6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:06.970920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 675/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 22:53:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:53:10.434960 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102f33-a0bd-45ce-87d6-cfbbb65d74b9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:10.436288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102f33-a0bd-45ce-87d6-cfbbb65d74b9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:10.436288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea102f33-a0bd-45ce-87d6-cfbbb65d74b9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:10.437580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 681/1356] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:10.446011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8387a3-ebd6-4094-a45c-8bfabd2edeeb None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:10.446899 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8387a3-ebd6-4094-a45c-8bfabd2edeeb None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:10.447174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8387a3-ebd6-4094-a45c-8bfabd2edeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:10.497801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:10.540605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-3c8387a3-ebd6-4094-a45c-8bfabd2edeeb None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:10.540605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3c8387a3-ebd6-4094-a45c-8bfabd2edeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:10.661369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 676/1357] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:10.728607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3317-3f5a-4a51-b836-f3f1f7a10fdf None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:10.729192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3317-3f5a-4a51-b836-f3f1f7a10fdf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:10.729625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3317-3f5a-4a51-b836-f3f1f7a10fdf None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:10.732263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 682/1358] 10.222.0.77 () {54 vars in 962 bytes} [Wed Aug 10 22:53:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:10.738211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950382f5-8ec3-4647-898d-977d38aae020 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:10.738825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950382f5-8ec3-4647-898d-977d38aae020 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:10.739303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950382f5-8ec3-4647-898d-977d38aae020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:10.824240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-950382f5-8ec3-4647-898d-977d38aae020 None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:10.826015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-950382f5-8ec3-4647-898d-977d38aae020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:10.888891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:10.963470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 677/1359] 10.222.0.77 () {58 vars in 1059 bytes} [Wed Aug 10 22:53:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:53:10.972619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f3317-3f5a-4a51-b836-f3f1f7a10fdf None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:10.974187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-449f3317-3f5a-4a51-b836-f3f1f7a10fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:11.142167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f3317-3f5a-4a51-b836-f3f1f7a10fdf None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:11.225571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:11.269984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23e21-fd81-48c6-a3e8-1ba6d3cfcff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:11.270627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23e21-fd81-48c6-a3e8-1ba6d3cfcff5 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:11.270897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23e21-fd81-48c6-a3e8-1ba6d3cfcff5 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:11.271165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23e21-fd81-48c6-a3e8-1ba6d3cfcff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:11.272940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6cf23e21-fd81-48c6-a3e8-1ba6d3cfcff5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:11.371283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23e21-fd81-48c6-a3e8-1ba6d3cfcff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:11.372899 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23e21-fd81-48c6-a3e8-1ba6d3cfcff5 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:11.392508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 683/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:13.677244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e614d1-95da-45be-b12d-06d6420513bb None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:13.677772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e614d1-95da-45be-b12d-06d6420513bb None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:13.677772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e614d1-95da-45be-b12d-06d6420513bb None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:13.679262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 678/1361] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:13.685121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f730d30-13c6-4e3e-b62b-ec7a0c2badb2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:13.686086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f730d30-13c6-4e3e-b62b-ec7a0c2badb2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:13.686261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f730d30-13c6-4e3e-b62b-ec7a0c2badb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:13.758191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7f730d30-13c6-4e3e-b62b-ec7a0c2badb2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:13.759374 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7f730d30-13c6-4e3e-b62b-ec7a0c2badb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:13.798972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:13.869744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 684/1362] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:13.913737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e614d1-95da-45be-b12d-06d6420513bb None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:13.915896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-23e614d1-95da-45be-b12d-06d6420513bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:14.095565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e614d1-95da-45be-b12d-06d6420513bb None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:14.105853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:14.268873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1a97c-fa34-4247-a3b9-6b9044a83772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:14.269549 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1a97c-fa34-4247-a3b9-6b9044a83772 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:14.270010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1a97c-fa34-4247-a3b9-6b9044a83772 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:14.270472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1a97c-fa34-4247-a3b9-6b9044a83772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:14.272109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f5a1a97c-fa34-4247-a3b9-6b9044a83772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:14.376298 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1a97c-fa34-4247-a3b9-6b9044a83772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:14.378065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1a97c-fa34-4247-a3b9-6b9044a83772 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:14.396753 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 679/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:16.923013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f33357-c70d-4ca1-b3d7-8386357b2895 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:16.923547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f33357-c70d-4ca1-b3d7-8386357b2895 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:16.923547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f33357-c70d-4ca1-b3d7-8386357b2895 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:16.924818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 685/1364] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:16.930478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7161b33-8e0f-4dcd-b44b-ae851b3f0db5 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:16.930922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7161b33-8e0f-4dcd-b44b-ae851b3f0db5 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:16.931023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7161b33-8e0f-4dcd-b44b-ae851b3f0db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:16.948234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:17.004583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c7161b33-8e0f-4dcd-b44b-ae851b3f0db5 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:17.005848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c7161b33-8e0f-4dcd-b44b-ae851b3f0db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:17.122615 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 680/1365] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:17.169784 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed4084-d309-4af6-9617-f18498898364 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:17.170099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed4084-d309-4af6-9617-f18498898364 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:17.170558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed4084-d309-4af6-9617-f18498898364 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:17.172494 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 686/1366] 10.222.0.77 () {54 vars in 962 bytes} [Wed Aug 10 22:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:17.184520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee810ee-bbb5-4cfe-b88d-e828a8f9449b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:17.184520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee810ee-bbb5-4cfe-b88d-e828a8f9449b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:17.184520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee810ee-bbb5-4cfe-b88d-e828a8f9449b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:17.269176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-eee810ee-bbb5-4cfe-b88d-e828a8f9449b None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:17.270423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-eee810ee-bbb5-4cfe-b88d-e828a8f9449b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:17.308821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:17.396700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 681/1367] 10.222.0.77 () {58 vars in 1059 bytes} [Wed Aug 10 22:53:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:17.404769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed4084-d309-4af6-9617-f18498898364 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:17.406942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-39ed4084-d309-4af6-9617-f18498898364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:17.566219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed4084-d309-4af6-9617-f18498898364 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:17.587309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:17.686044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffa5ec-5b2d-4846-bd92-ae9e83424113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:17.686648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffa5ec-5b2d-4846-bd92-ae9e83424113 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:17.686920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffa5ec-5b2d-4846-bd92-ae9e83424113 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:17.687184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffa5ec-5b2d-4846-bd92-ae9e83424113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:17.688794 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-55ffa5ec-5b2d-4846-bd92-ae9e83424113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:17.784552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffa5ec-5b2d-4846-bd92-ae9e83424113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:17.786200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffa5ec-5b2d-4846-bd92-ae9e83424113 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:17.805907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 687/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 22:53:18.723207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0952-ae70-4502-a749-231a6dde2379 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:18.723763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0952-ae70-4502-a749-231a6dde2379 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:18.723763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d0952-ae70-4502-a749-231a6dde2379 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:18.725102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 682/1369] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:18.731178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53d1e7-1eb6-4dad-81f1-02e9c45c7174 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:18.731624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53d1e7-1eb6-4dad-81f1-02e9c45c7174 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:18.731703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53d1e7-1eb6-4dad-81f1-02e9c45c7174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:18.764254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:18.800573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2b53d1e7-1eb6-4dad-81f1-02e9c45c7174 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:18.801716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2b53d1e7-1eb6-4dad-81f1-02e9c45c7174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:18.905434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 688/1370] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:19.248249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c93e67-8e6e-480f-a317-b021e7039612 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:19.248249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c93e67-8e6e-480f-a317-b021e7039612 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:19.248249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c93e67-8e6e-480f-a317-b021e7039612 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:19.250116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 683/1371] 10.222.0.77 () {54 vars in 964 bytes} [Wed Aug 10 22:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:19.254531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62130fed-fc29-40f2-8ea7-58b68f344061 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:19.254813 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62130fed-fc29-40f2-8ea7-58b68f344061 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:19.255080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62130fed-fc29-40f2-8ea7-58b68f344061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:19.348161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-62130fed-fc29-40f2-8ea7-58b68f344061 None None] MFA Rules not processed for user `3eca4101d5a74563855c7fa3dcf1ccc0`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:19.349404 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-62130fed-fc29-40f2-8ea7-58b68f344061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:19.397697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:19.427447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 689/1372] 10.222.0.77 () {58 vars in 1061 bytes} [Wed Aug 10 22:53:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:19.435823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c93e67-8e6e-480f-a317-b021e7039612 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:19.437476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-50c93e67-8e6e-480f-a317-b021e7039612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:19.550635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c93e67-8e6e-480f-a317-b021e7039612 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:19.596650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:19.634178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0814a-4220-454a-97dd-742bfee32ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:19.634787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0814a-4220-454a-97dd-742bfee32ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:19.635084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0814a-4220-454a-97dd-742bfee32ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:19.635356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0814a-4220-454a-97dd-742bfee32ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:19.636991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-28c0814a-4220-454a-97dd-742bfee32ee6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:19.755899 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0814a-4220-454a-97dd-742bfee32ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:19.757635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0814a-4220-454a-97dd-742bfee32ee6 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:19.777848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 684/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:20.109051 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7b06-7916-4bb5-aa93-f6000062b49d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:20.109728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7b06-7916-4bb5-aa93-f6000062b49d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:20.109728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb7b06-7916-4bb5-aa93-f6000062b49d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:20.111636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 690/1374] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:20.116210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33532-22f5-487c-91db-401914868a25 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:20.116684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33532-22f5-487c-91db-401914868a25 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:20.116902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f33532-22f5-487c-91db-401914868a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:20.194467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-24f33532-22f5-487c-91db-401914868a25 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:20.196290 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-24f33532-22f5-487c-91db-401914868a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:20.224647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:20.302686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 685/1375] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:20.347383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb7b06-7916-4bb5-aa93-f6000062b49d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:20.348928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-43bb7b06-7916-4bb5-aa93-f6000062b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:20.495639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb7b06-7916-4bb5-aa93-f6000062b49d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:20.546459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:20.610836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16bcb3-970f-4298-81f2-d22916362bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:20.611437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16bcb3-970f-4298-81f2-d22916362bea service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:20.611706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16bcb3-970f-4298-81f2-d22916362bea service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:20.611975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16bcb3-970f-4298-81f2-d22916362bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:20.613575 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4a16bcb3-970f-4298-81f2-d22916362bea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:20.703678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16bcb3-970f-4298-81f2-d22916362bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:20.705272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16bcb3-970f-4298-81f2-d22916362bea service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:20.723672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 691/1376] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:22.912484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92d0c6-0a11-4e55-9efd-7ccc2a0a34a7 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:22.912996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92d0c6-0a11-4e55-9efd-7ccc2a0a34a7 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:22.913125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92d0c6-0a11-4e55-9efd-7ccc2a0a34a7 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:22.918753 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 686/1377] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:22.920154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c917e06-c512-40dd-8cb1-aa1e398b7db3 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:22.920568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c917e06-c512-40dd-8cb1-aa1e398b7db3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:22.920761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c917e06-c512-40dd-8cb1-aa1e398b7db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:22.999093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5c917e06-c512-40dd-8cb1-aa1e398b7db3 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:23.000293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5c917e06-c512-40dd-8cb1-aa1e398b7db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:23.018931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:23.105648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 692/1378] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:23.151447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92d0c6-0a11-4e55-9efd-7ccc2a0a34a7 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:23.153129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fd92d0c6-0a11-4e55-9efd-7ccc2a0a34a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:23.302391 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92d0c6-0a11-4e55-9efd-7ccc2a0a34a7 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:23.306494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:23.492249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ee1c2-9e84-4cc8-9faf-ca60296f65cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:23.492946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee1c2-9e84-4cc8-9faf-ca60296f65cb service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:23.496311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee1c2-9e84-4cc8-9faf-ca60296f65cb service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:23.496311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ee1c2-9e84-4cc8-9faf-ca60296f65cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:23.497373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-116ee1c2-9e84-4cc8-9faf-ca60296f65cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:23.654848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ee1c2-9e84-4cc8-9faf-ca60296f65cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:23.656617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ee1c2-9e84-4cc8-9faf-ca60296f65cb service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:23.677439 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 687/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:25.906893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25599b-fa80-461a-809a-1dc180dcfd22 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:25.907466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25599b-fa80-461a-809a-1dc180dcfd22 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:25.907792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25599b-fa80-461a-809a-1dc180dcfd22 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:25.915070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 693/1380] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:25.919281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371316-2e9f-4441-8ef4-78c0f677da2e None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:25.919691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371316-2e9f-4441-8ef4-78c0f677da2e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:25.920671 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0371316-2e9f-4441-8ef4-78c0f677da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:25.933185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:25.995655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b0371316-2e9f-4441-8ef4-78c0f677da2e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:25.996867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b0371316-2e9f-4441-8ef4-78c0f677da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:26.105808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 688/1381] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:26.150434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25599b-fa80-461a-809a-1dc180dcfd22 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:26.152266 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4f25599b-fa80-461a-809a-1dc180dcfd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:26.311297 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:26.323567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25599b-fa80-461a-809a-1dc180dcfd22 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:26.460710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cafbfa-b3ed-4274-b10c-b475e63b66cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:26.461460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cafbfa-b3ed-4274-b10c-b475e63b66cf service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:26.461841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cafbfa-b3ed-4274-b10c-b475e63b66cf service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:26.462215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cafbfa-b3ed-4274-b10c-b475e63b66cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:26.463983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d3cafbfa-b3ed-4274-b10c-b475e63b66cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:26.588337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cafbfa-b3ed-4274-b10c-b475e63b66cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:26.590365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cafbfa-b3ed-4274-b10c-b475e63b66cf service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:26.603270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:26.612305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 694/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:29.151247 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d84b9-af12-4337-a431-84a72d39a137 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:29.151922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d84b9-af12-4337-a431-84a72d39a137 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:29.151922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d84b9-af12-4337-a431-84a72d39a137 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:29.153342 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 689/1383] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:29.159084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72df4-83d6-4b2b-a5e4-0f05eefa4cc6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:29.159657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72df4-83d6-4b2b-a5e4-0f05eefa4cc6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:29.159779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72df4-83d6-4b2b-a5e4-0f05eefa4cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:29.240904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-08d72df4-83d6-4b2b-a5e4-0f05eefa4cc6 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:29.242351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-08d72df4-83d6-4b2b-a5e4-0f05eefa4cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:29.347167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 695/1384] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:53:29.393413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d84b9-af12-4337-a431-84a72d39a137 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:29.395073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1a4d84b9-af12-4337-a431-84a72d39a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:29.488124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:29.559662 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d84b9-af12-4337-a431-84a72d39a137 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:29.816230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd874c-60f8-49d6-ba8f-472898d80eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:29.817150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd874c-60f8-49d6-ba8f-472898d80eca service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:29.817545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd874c-60f8-49d6-ba8f-472898d80eca service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:29.817915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd874c-60f8-49d6-ba8f-472898d80eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:29.820163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c4dd874c-60f8-49d6-ba8f-472898d80eca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:29.885108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:29.927406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd874c-60f8-49d6-ba8f-472898d80eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:29.929683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd874c-60f8-49d6-ba8f-472898d80eca service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:29.948746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 690/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:31.961839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d4e5-bb9c-4e8e-8606-3ef7665e6f94 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:31.962624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d4e5-bb9c-4e8e-8606-3ef7665e6f94 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:31.962624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4d4e5-bb9c-4e8e-8606-3ef7665e6f94 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:31.963707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 696/1386] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:31.969788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d37380-db68-486f-9ad5-d18df7e2bff8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:31.970245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d37380-db68-486f-9ad5-d18df7e2bff8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:31.970598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d37380-db68-486f-9ad5-d18df7e2bff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:32.052171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c4d37380-db68-486f-9ad5-d18df7e2bff8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:32.053742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c4d37380-db68-486f-9ad5-d18df7e2bff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:32.176561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 691/1387] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:32.224729 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4d4e5-bb9c-4e8e-8606-3ef7665e6f94 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:32.226868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-45a4d4e5-bb9c-4e8e-8606-3ef7665e6f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:32.317558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:32.403534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4d4e5-bb9c-4e8e-8606-3ef7665e6f94 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:32.536135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1c5b8-0895-46d9-a08c-765494e99660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:32.536820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1c5b8-0895-46d9-a08c-765494e99660 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:32.537157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1c5b8-0895-46d9-a08c-765494e99660 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:32.537525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1c5b8-0895-46d9-a08c-765494e99660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:32.540117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eba1c5b8-0895-46d9-a08c-765494e99660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:32.590408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:32.662766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1c5b8-0895-46d9-a08c-765494e99660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:32.666092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1c5b8-0895-46d9-a08c-765494e99660 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:32.692115 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 697/1388] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:34.891371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee81b7-cd73-486f-a42e-6ce7fc3979f7 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:34.891901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee81b7-cd73-486f-a42e-6ce7fc3979f7 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:34.891994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee81b7-cd73-486f-a42e-6ce7fc3979f7 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:34.893349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 692/1389] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:34.899315 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74f10d-406d-40f8-9619-4712adee6603 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:34.899796 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74f10d-406d-40f8-9619-4712adee6603 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:34.899914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74f10d-406d-40f8-9619-4712adee6603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:34.966925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ea74f10d-406d-40f8-9619-4712adee6603 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:34.968127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ea74f10d-406d-40f8-9619-4712adee6603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:35.063365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 698/1390] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:35.111040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee81b7-cd73-486f-a42e-6ce7fc3979f7 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:35.112746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-44ee81b7-cd73-486f-a42e-6ce7fc3979f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:35.178619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:35.268230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee81b7-cd73-486f-a42e-6ce7fc3979f7 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:35.312192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1f25-c841-4fad-b2a6-b6432685b1ca None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:35.312694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1f25-c841-4fad-b2a6-b6432685b1ca None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:35.312951 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f1f25-c841-4fad-b2a6-b6432685b1ca None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:35.314824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 699/1391] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:53:35.320511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd414f-092a-46fd-bea9-17d8b03ed11a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:35.320786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd414f-092a-46fd-bea9-17d8b03ed11a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:35.321056 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd414f-092a-46fd-bea9-17d8b03ed11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:35.337260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:35.384933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfd844-5a69-4758-a340-8353b4a5b72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:35.389075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd844-5a69-4758-a340-8353b4a5b72a service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:35.389075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd844-5a69-4758-a340-8353b4a5b72a service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:35.389075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfd844-5a69-4758-a340-8353b4a5b72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:35.389075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-00bfd844-5a69-4758-a340-8353b4a5b72a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:35.390740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cdcd414f-092a-46fd-bea9-17d8b03ed11a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:35.391908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cdcd414f-092a-46fd-bea9-17d8b03ed11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:35.407780 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:35.481180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfd844-5a69-4758-a340-8353b4a5b72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:35.482801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfd844-5a69-4758-a340-8353b4a5b72a service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:35.491821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 700/1392] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:53:35.501613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 693/1393] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:35.547566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a10a3-3458-48f5-977f-3e71378dad0b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:35.547850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a10a3-3458-48f5-977f-3e71378dad0b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:35.548120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a10a3-3458-48f5-977f-3e71378dad0b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:35.553234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 701/1394] 10.222.0.77 () {54 vars in 967 bytes} [Wed Aug 10 22:53:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:35.554853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56bc0-8bff-4007-b4e1-0e6ab3243e22 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:35.555140 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56bc0-8bff-4007-b4e1-0e6ab3243e22 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:35.555414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56bc0-8bff-4007-b4e1-0e6ab3243e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:35.638244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-21b56bc0-8bff-4007-b4e1-0e6ab3243e22 None None] MFA Rules not processed for user `6e86be85010d4851a1ce3381832af230`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:35.639455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-21b56bc0-8bff-4007-b4e1-0e6ab3243e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:35.693255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:35.720675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 694/1395] 10.222.0.77 () {58 vars in 1064 bytes} [Wed Aug 10 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:53:35.729268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a10a3-3458-48f5-977f-3e71378dad0b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:35.730905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3d7a10a3-3458-48f5-977f-3e71378dad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:35.841693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:35.848660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a10a3-3458-48f5-977f-3e71378dad0b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:35.925178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847be804-eef4-4c95-8e5f-567692f2f41a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e86be85010d4851a1ce3381832af230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:35.925881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be804-eef4-4c95-8e5f-567692f2f41a service glance] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:35.926151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be804-eef4-4c95-8e5f-567692f2f41a service glance] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:35.926408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be804-eef4-4c95-8e5f-567692f2f41a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:35.928006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-847be804-eef4-4c95-8e5f-567692f2f41a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:36.040539 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847be804-eef4-4c95-8e5f-567692f2f41a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:36.042047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847be804-eef4-4c95-8e5f-567692f2f41a service glance] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:36.060175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 702/1396] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:36.968525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751358d-7a90-4d5e-b564-5ce6cec29722 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:36.969008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751358d-7a90-4d5e-b564-5ce6cec29722 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:36.969184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751358d-7a90-4d5e-b564-5ce6cec29722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:37.038002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-4751358d-7a90-4d5e-b564-5ce6cec29722 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:37.039771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4751358d-7a90-4d5e-b564-5ce6cec29722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:37.125831 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 695/1397] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 22:53:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:37.167704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01abc60-6583-48ec-b3ce-62195322e65a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:37.168173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01abc60-6583-48ec-b3ce-62195322e65a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:37.168295 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01abc60-6583-48ec-b3ce-62195322e65a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:37.169593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 703/1398] 10.222.0.77 () {54 vars in 943 bytes} [Wed Aug 10 22:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:37.175754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e80ee-0625-4b34-97f4-845e9a62492d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:37.176032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e80ee-0625-4b34-97f4-845e9a62492d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:37.176365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e80ee-0625-4b34-97f4-845e9a62492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:37.254213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-785e80ee-0625-4b34-97f4-845e9a62492d None None] MFA Rules not processed for user `6c892a519c8348728d43f0f0d447a321`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:37.255450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-785e80ee-0625-4b34-97f4-845e9a62492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:37.269037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:37.366728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 696/1399] 10.222.0.77 () {58 vars in 1040 bytes} [Wed Aug 10 22:53:37 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:37.376092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01abc60-6583-48ec-b3ce-62195322e65a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:37.377660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a01abc60-6583-48ec-b3ce-62195322e65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:37.405780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:37.521592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01abc60-6583-48ec-b3ce-62195322e65a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:37.629264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9129dd-c466-49c9-91ff-dc7c52b442d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:37.629955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9129dd-c466-49c9-91ff-dc7c52b442d9 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:37.630174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9129dd-c466-49c9-91ff-dc7c52b442d9 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:37.630445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9129dd-c466-49c9-91ff-dc7c52b442d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:37.632145 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cc9129dd-c466-49c9-91ff-dc7c52b442d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:37.639437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:37.704261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130639ed-edf2-4373-95d2-71f493337722 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:37.704548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130639ed-edf2-4373-95d2-71f493337722 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:37.704843 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130639ed-edf2-4373-95d2-71f493337722 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:37.706284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 697/1400] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:53:37.711959 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3556ea6-b6a4-440d-87ed-5ba866e756fa None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:37.712227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3556ea6-b6a4-440d-87ed-5ba866e756fa None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:37.712495 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3556ea6-b6a4-440d-87ed-5ba866e756fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:37.717811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9129dd-c466-49c9-91ff-dc7c52b442d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:37.719402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9129dd-c466-49c9-91ff-dc7c52b442d9 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:37.728550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 704/1401] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 22:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 22:53:37.782655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-a3556ea6-b6a4-440d-87ed-5ba866e756fa None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:37.783761 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a3556ea6-b6a4-440d-87ed-5ba866e756fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:37.857587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:37.879402 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 698/1402] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:53:37.924364 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9129dd-c466-49c9-91ff-dc7c52b442d9 service swift] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:37.929463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cc9129dd-c466-49c9-91ff-dc7c52b442d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:38.022033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9129dd-c466-49c9-91ff-dc7c52b442d9 service swift] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:38.078144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:38.148006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa11af-d039-4c31-8ec4-bea9ca6fbb48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:38.148626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa11af-d039-4c31-8ec4-bea9ca6fbb48 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:38.148903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa11af-d039-4c31-8ec4-bea9ca6fbb48 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:38.149205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa11af-d039-4c31-8ec4-bea9ca6fbb48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:38.150908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-47aa11af-d039-4c31-8ec4-bea9ca6fbb48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:38.276352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa11af-d039-4c31-8ec4-bea9ca6fbb48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:38.277994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa11af-d039-4c31-8ec4-bea9ca6fbb48 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:38.311937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 705/1403] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:40.544511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df3d7f-85cc-4fc2-8551-5b639afdac68 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:40.545064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df3d7f-85cc-4fc2-8551-5b639afdac68 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:40.545064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df3d7f-85cc-4fc2-8551-5b639afdac68 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:40.546632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 699/1404] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:40.552051 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ae437-0360-4c9c-84d1-2d3190671c5f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:40.552555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ae437-0360-4c9c-84d1-2d3190671c5f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:40.552646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ae437-0360-4c9c-84d1-2d3190671c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:40.640674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a58ae437-0360-4c9c-84d1-2d3190671c5f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:40.642217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a58ae437-0360-4c9c-84d1-2d3190671c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:40.660973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:40.777863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 706/1405] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:40.826144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df3d7f-85cc-4fc2-8551-5b639afdac68 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:40.827690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d8df3d7f-85cc-4fc2-8551-5b639afdac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:41.025070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df3d7f-85cc-4fc2-8551-5b639afdac68 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:41.104027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:41.175043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52d0a0-b5c5-4c3e-8b47-752d42472804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:41.175660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d0a0-b5c5-4c3e-8b47-752d42472804 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:41.175930 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d0a0-b5c5-4c3e-8b47-752d42472804 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:41.176196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d0a0-b5c5-4c3e-8b47-752d42472804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:41.177856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4e52d0a0-b5c5-4c3e-8b47-752d42472804 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:41.280084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52d0a0-b5c5-4c3e-8b47-752d42472804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:41.281733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52d0a0-b5c5-4c3e-8b47-752d42472804 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:41.300254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 700/1406] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:43.525012 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b217ea-4c07-4bab-890b-4b13c3514c17 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:43.525630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b217ea-4c07-4bab-890b-4b13c3514c17 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:43.525630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b217ea-4c07-4bab-890b-4b13c3514c17 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:43.526950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 707/1407] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:53:43.532548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09850fae-c0c5-4e31-a647-9e59fd7eda41 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:43.533051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09850fae-c0c5-4e31-a647-9e59fd7eda41 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:43.533142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09850fae-c0c5-4e31-a647-9e59fd7eda41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:43.612432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-09850fae-c0c5-4e31-a647-9e59fd7eda41 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:53:43.612432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-09850fae-c0c5-4e31-a647-9e59fd7eda41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:43.638984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:43.734592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 701/1408] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:53:43.779921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b217ea-4c07-4bab-890b-4b13c3514c17 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:53:43.783587 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a5b217ea-4c07-4bab-890b-4b13c3514c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:43.947814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:43.950557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b217ea-4c07-4bab-890b-4b13c3514c17 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:53:44.074982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0fb37-83f1-4fed-9455-064f3803aebb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:53:44.075517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0fb37-83f1-4fed-9455-064f3803aebb service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:53:44.075798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0fb37-83f1-4fed-9455-064f3803aebb service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:53:44.076070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0fb37-83f1-4fed-9455-064f3803aebb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:53:44.077698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-77e0fb37-83f1-4fed-9455-064f3803aebb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:53:44.179048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0fb37-83f1-4fed-9455-064f3803aebb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:53:44.181140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0fb37-83f1-4fed-9455-064f3803aebb service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:53:44.200274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 708/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:53:53.732740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=35 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:54.197857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:01.908412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aca64-990e-450f-b243-fec1f3e79a8f None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:01.908947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aca64-990e-450f-b243-fec1f3e79a8f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:01.908947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aca64-990e-450f-b243-fec1f3e79a8f None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:01.910236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 702/1410] 10.222.0.77 () {54 vars in 918 bytes} [Wed Aug 10 22:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:01.916119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e39ba-52ee-4d46-9815-13087aba69f4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:01.916576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e39ba-52ee-4d46-9815-13087aba69f4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:01.916754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e39ba-52ee-4d46-9815-13087aba69f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:01.992991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-992e39ba-52ee-4d46-9815-13087aba69f4 None None] MFA Rules not processed for user `6d9439b0577446f1ae9ff61a23df4143`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:01.994282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-992e39ba-52ee-4d46-9815-13087aba69f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:02.100174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 709/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Wed Aug 10 22:54:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:02.117523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00b611-ccd3-46c3-bdc6-f9eed0dbc2b8 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:02.117798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00b611-ccd3-46c3-bdc6-f9eed0dbc2b8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:02.118065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00b611-ccd3-46c3-bdc6-f9eed0dbc2b8 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:02.119389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 703/1412] 10.222.0.77 () {54 vars in 918 bytes} [Wed Aug 10 22:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:02.124294 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5409-be2d-4273-8aad-2c358fde71a4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:02.124580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5409-be2d-4273-8aad-2c358fde71a4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:02.124852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5409-be2d-4273-8aad-2c358fde71a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:02.198088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:02.201036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d4bd5409-be2d-4273-8aad-2c358fde71a4 None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:02.202296 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d4bd5409-be2d-4273-8aad-2c358fde71a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:02.317307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 710/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Wed Aug 10 22:54:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:04.779252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e0563-98d2-41db-9b4f-55011807ade6 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:04.779817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e0563-98d2-41db-9b4f-55011807ade6 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:04.779817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e0563-98d2-41db-9b4f-55011807ade6 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:04.781097 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:04.786480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f696-2b88-492b-9353-a05ee5d0c6f9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:04.786897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f696-2b88-492b-9353-a05ee5d0c6f9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:04.787591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f696-2b88-492b-9353-a05ee5d0c6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:04.853187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-70a0f696-2b88-492b-9353-a05ee5d0c6f9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:04.854410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-70a0f696-2b88-492b-9353-a05ee5d0c6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:04.908787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:04.952167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:54:04.996600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e0563-98d2-41db-9b4f-55011807ade6 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:04.998224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-092e0563-98d2-41db-9b4f-55011807ade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:05.142029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e0563-98d2-41db-9b4f-55011807ade6 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:05.218112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:05.258632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2d3f8-bc69-4102-a4f5-4f8cfcef0217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:05.259233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2d3f8-bc69-4102-a4f5-4f8cfcef0217 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:05.259535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2d3f8-bc69-4102-a4f5-4f8cfcef0217 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:05.259848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2d3f8-bc69-4102-a4f5-4f8cfcef0217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:05.261532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fec2d3f8-bc69-4102-a4f5-4f8cfcef0217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:05.351419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2d3f8-bc69-4102-a4f5-4f8cfcef0217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:05.353000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2d3f8-bc69-4102-a4f5-4f8cfcef0217 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:05.371426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 705/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:06.320440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483c1a3-4999-4215-b051-14d161378158 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:06.321091 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483c1a3-4999-4215-b051-14d161378158 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:06.321091 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483c1a3-4999-4215-b051-14d161378158 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:06.322336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:06.327281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d6433-7280-4c3c-8e4e-11ad53b5efdc None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:06.327686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d6433-7280-4c3c-8e4e-11ad53b5efdc None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:06.327819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d6433-7280-4c3c-8e4e-11ad53b5efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:06.403364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ca0d6433-7280-4c3c-8e4e-11ad53b5efdc None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:06.404576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ca0d6433-7280-4c3c-8e4e-11ad53b5efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:06.430707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:06.499763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:06.656453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483c1a3-4999-4215-b051-14d161378158 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:06.658122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9483c1a3-4999-4215-b051-14d161378158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:06.808081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483c1a3-4999-4215-b051-14d161378158 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:06.848155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:06.920061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c0e83-7299-49fb-85d9-c92b5128314d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:06.920683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c0e83-7299-49fb-85d9-c92b5128314d service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:06.920956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c0e83-7299-49fb-85d9-c92b5128314d service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:06.921222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c0e83-7299-49fb-85d9-c92b5128314d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:06.922840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-722c0e83-7299-49fb-85d9-c92b5128314d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:07.012399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c0e83-7299-49fb-85d9-c92b5128314d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:07.014022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c0e83-7299-49fb-85d9-c92b5128314d service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:07.031847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 713/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:07.918461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d066-de81-4b2a-a0da-9c3ce013a50c None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:07.919008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d066-de81-4b2a-a0da-9c3ce013a50c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:07.919008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202d066-de81-4b2a-a0da-9c3ce013a50c None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:07.920258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:07.925439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b40fc-6195-418f-91bf-5aac4c966a45 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:07.925862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b40fc-6195-418f-91bf-5aac4c966a45 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:07.925978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b40fc-6195-418f-91bf-5aac4c966a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:07.979616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:08.001707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-db1b40fc-6195-418f-91bf-5aac4c966a45 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:08.002905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-db1b40fc-6195-418f-91bf-5aac4c966a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:08.099979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:08.253253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202d066-de81-4b2a-a0da-9c3ce013a50c None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:08.254901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5202d066-de81-4b2a-a0da-9c3ce013a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:08.400500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202d066-de81-4b2a-a0da-9c3ce013a50c None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:08.413034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:08.513058 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074483-7a7b-42e9-b5cc-d6ebb387ceb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:08.513602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074483-7a7b-42e9-b5cc-d6ebb387ceb0 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:08.513873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074483-7a7b-42e9-b5cc-d6ebb387ceb0 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:08.514137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074483-7a7b-42e9-b5cc-d6ebb387ceb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:08.515714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a6074483-7a7b-42e9-b5cc-d6ebb387ceb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:08.604728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6074483-7a7b-42e9-b5cc-d6ebb387ceb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:08.606323 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6074483-7a7b-42e9-b5cc-d6ebb387ceb0 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:08.623696 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 708/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:09.488101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e755f81-9238-4dd3-bb18-ece25173627d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:09.488688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e755f81-9238-4dd3-bb18-ece25173627d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:09.488688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e755f81-9238-4dd3-bb18-ece25173627d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:09.490045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:09.494972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a582d7-5096-4e91-a7a3-f9589dee7ea4 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:09.495429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a582d7-5096-4e91-a7a3-f9589dee7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:09.495550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a582d7-5096-4e91-a7a3-f9589dee7ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:09.516460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:09.574864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-98a582d7-5096-4e91-a7a3-f9589dee7ea4 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:09.576072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-98a582d7-5096-4e91-a7a3-f9589dee7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:09.672719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:09.823865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e755f81-9238-4dd3-bb18-ece25173627d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:09.825284 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6e755f81-9238-4dd3-bb18-ece25173627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:09.933927 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:09.969455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e755f81-9238-4dd3-bb18-ece25173627d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:10.081753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27652a5-8ddf-45a9-b965-24e6bf618479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:10.082275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27652a5-8ddf-45a9-b965-24e6bf618479 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:10.082552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27652a5-8ddf-45a9-b965-24e6bf618479 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:10.082825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27652a5-8ddf-45a9-b965-24e6bf618479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:10.084489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a27652a5-8ddf-45a9-b965-24e6bf618479 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:10.160095 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:10.174098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27652a5-8ddf-45a9-b965-24e6bf618479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:10.175716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27652a5-8ddf-45a9-b965-24e6bf618479 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:10.194424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 716/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:11.069587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205292f7-361d-48c2-a624-ccabc6262b9f None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:11.070180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205292f7-361d-48c2-a624-ccabc6262b9f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:11.070180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205292f7-361d-48c2-a624-ccabc6262b9f None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:11.071485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:54:11.076520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd8156-f7b4-4b35-9dc3-95caca5c4cf0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:11.076952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd8156-f7b4-4b35-9dc3-95caca5c4cf0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:11.077074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd8156-f7b4-4b35-9dc3-95caca5c4cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:11.154157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-63bd8156-f7b4-4b35-9dc3-95caca5c4cf0 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:11.155367 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-63bd8156-f7b4-4b35-9dc3-95caca5c4cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:11.253123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:11.403495 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205292f7-361d-48c2-a624-ccabc6262b9f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:11.404939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-205292f7-361d-48c2-a624-ccabc6262b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:11.488228 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:11.550029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205292f7-361d-48c2-a624-ccabc6262b9f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:11.665807 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7447b9-3570-4154-a3e1-509a00ac1c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:11.666450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7447b9-3570-4154-a3e1-509a00ac1c07 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:11.666717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7447b9-3570-4154-a3e1-509a00ac1c07 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:11.666976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7447b9-3570-4154-a3e1-509a00ac1c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:11.668618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ae7447b9-3570-4154-a3e1-509a00ac1c07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:11.718051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:11.761260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7447b9-3570-4154-a3e1-509a00ac1c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:11.762888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7447b9-3570-4154-a3e1-509a00ac1c07 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:11.780791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 711/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:12.653206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71636e-9968-4c41-9795-53c923e4c970 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:12.653792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71636e-9968-4c41-9795-53c923e4c970 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:12.653792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71636e-9968-4c41-9795-53c923e4c970 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:12.655113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:12.660838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0740-8d48-4793-a8e0-6040a7036af0 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:12.661366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0740-8d48-4793-a8e0-6040a7036af0 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:12.661366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0740-8d48-4793-a8e0-6040a7036af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:12.744237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-985e0740-8d48-4793-a8e0-6040a7036af0 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:12.745512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-985e0740-8d48-4793-a8e0-6040a7036af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:12.842299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:54:12.997167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71636e-9968-4c41-9795-53c923e4c970 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:12.998725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1d71636e-9968-4c41-9795-53c923e4c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:13.047971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:13.270553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71636e-9968-4c41-9795-53c923e4c970 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:13.387155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c182420-f81c-4c51-86ba-68e1e7796d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:13.387755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182420-f81c-4c51-86ba-68e1e7796d41 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:13.388030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182420-f81c-4c51-86ba-68e1e7796d41 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:13.388288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182420-f81c-4c51-86ba-68e1e7796d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:13.390129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8c182420-f81c-4c51-86ba-68e1e7796d41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:13.398167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:13.484976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c182420-f81c-4c51-86ba-68e1e7796d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:13.486626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c182420-f81c-4c51-86ba-68e1e7796d41 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:13.504897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 719/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:14.497098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b12271-1008-487d-a75a-f6d607fad5d7 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:14.497659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b12271-1008-487d-a75a-f6d607fad5d7 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:14.497659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b12271-1008-487d-a75a-f6d607fad5d7 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:14.499017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:14.504578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd829e3-d5e8-4602-a5da-263f76878e6a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:14.505027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd829e3-d5e8-4602-a5da-263f76878e6a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:14.505122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd829e3-d5e8-4602-a5da-263f76878e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:14.584713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7cd829e3-d5e8-4602-a5da-263f76878e6a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:14.585953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7cd829e3-d5e8-4602-a5da-263f76878e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:14.654520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:14.685850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:14.837143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b12271-1008-487d-a75a-f6d607fad5d7 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:14.838602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f4b12271-1008-487d-a75a-f6d607fad5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:14.856281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:14.985319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b12271-1008-487d-a75a-f6d607fad5d7 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:15.070786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:15.097320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd31708-c86a-4f26-b7c1-a0e281333f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:15.097854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31708-c86a-4f26-b7c1-a0e281333f4a service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:15.098127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31708-c86a-4f26-b7c1-a0e281333f4a service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:15.098389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31708-c86a-4f26-b7c1-a0e281333f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:15.100598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6fd31708-c86a-4f26-b7c1-a0e281333f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:15.188249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd31708-c86a-4f26-b7c1-a0e281333f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:15.189888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd31708-c86a-4f26-b7c1-a0e281333f4a service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:15.207982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 714/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:16.082125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a50350-6b94-4c86-b3e1-785af673db5b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:16.082701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a50350-6b94-4c86-b3e1-785af673db5b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:16.082701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a50350-6b94-4c86-b3e1-785af673db5b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:16.084664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:16.089996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272b395-98e9-43e7-8b98-186b522353d7 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:16.090494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272b395-98e9-43e7-8b98-186b522353d7 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:16.090590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272b395-98e9-43e7-8b98-186b522353d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:16.168604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-d272b395-98e9-43e7-8b98-186b522353d7 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:16.169829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d272b395-98e9-43e7-8b98-186b522353d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:16.222757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:16.281645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:16.434328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a50350-6b94-4c86-b3e1-785af673db5b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:16.436033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b7a50350-6b94-4c86-b3e1-785af673db5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:16.587833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a50350-6b94-4c86-b3e1-785af673db5b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:16.650322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:16.711682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968b89a-fd62-471e-a962-d15512749de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:16.712278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b89a-fd62-471e-a962-d15512749de4 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:16.712546 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b89a-fd62-471e-a962-d15512749de4 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:16.712806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968b89a-fd62-471e-a962-d15512749de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:16.714578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f968b89a-fd62-471e-a962-d15512749de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:16.811222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968b89a-fd62-471e-a962-d15512749de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:16.812692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968b89a-fd62-471e-a962-d15512749de4 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:16.831780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 722/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:17.671946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a876a0-d791-4a93-b6bb-7d805dd6319e None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:17.672474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a876a0-d791-4a93-b6bb-7d805dd6319e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:17.672474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a876a0-d791-4a93-b6bb-7d805dd6319e None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:17.673851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:17.678828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa1126-6f29-43d2-8a76-3a59ac4279ca None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:17.679247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa1126-6f29-43d2-8a76-3a59ac4279ca None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:17.679379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa1126-6f29-43d2-8a76-3a59ac4279ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:17.754845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f7fa1126-6f29-43d2-8a76-3a59ac4279ca None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:17.756536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f7fa1126-6f29-43d2-8a76-3a59ac4279ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:17.758557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:17.852213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:54:18.002520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a876a0-d791-4a93-b6bb-7d805dd6319e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:18.004098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-97a876a0-d791-4a93-b6bb-7d805dd6319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:18.148947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a876a0-d791-4a93-b6bb-7d805dd6319e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:18.178992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:18.266953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a6516-7648-43c1-9ebd-b91d16c610b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:18.267552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6516-7648-43c1-9ebd-b91d16c610b9 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:18.267823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6516-7648-43c1-9ebd-b91d16c610b9 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:18.268088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a6516-7648-43c1-9ebd-b91d16c610b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:18.269707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-192a6516-7648-43c1-9ebd-b91d16c610b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:18.358659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a6516-7648-43c1-9ebd-b91d16c610b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:18.360235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a6516-7648-43c1-9ebd-b91d16c610b9 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:18.377776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 717/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:20.277925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa96e17-8742-4998-bcc2-5349dfd23402 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:20.278467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa96e17-8742-4998-bcc2-5349dfd23402 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:20.278467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa96e17-8742-4998-bcc2-5349dfd23402 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:20.279793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:20.284901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02706f3-474d-473e-b79d-a531bcd504e8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:20.285359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02706f3-474d-473e-b79d-a531bcd504e8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:20.285527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02706f3-474d-473e-b79d-a531bcd504e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:20.326067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:20.350622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f02706f3-474d-473e-b79d-a531bcd504e8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:20.351819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f02706f3-474d-473e-b79d-a531bcd504e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:20.450020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:20.488485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa96e17-8742-4998-bcc2-5349dfd23402 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:20.490554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ffa96e17-8742-4998-bcc2-5349dfd23402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:20.590288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa96e17-8742-4998-bcc2-5349dfd23402 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:20.622250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:20.661877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722d6fe-ff85-49ba-acc5-9ff668134ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:20.662471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722d6fe-ff85-49ba-acc5-9ff668134ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:20.662739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722d6fe-ff85-49ba-acc5-9ff668134ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:20.662998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722d6fe-ff85-49ba-acc5-9ff668134ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:20.664562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7722d6fe-ff85-49ba-acc5-9ff668134ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:20.770379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722d6fe-ff85-49ba-acc5-9ff668134ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:20.771832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722d6fe-ff85-49ba-acc5-9ff668134ce8 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:20.790050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 725/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:22.936164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516137-3b7a-4d90-8876-ab1a7ba0d903 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:22.936745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516137-3b7a-4d90-8876-ab1a7ba0d903 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:22.936745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516137-3b7a-4d90-8876-ab1a7ba0d903 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:22.938081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:22.943200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa370-5a85-40f1-a439-d9c2d54c0ca2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:22.943667 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa370-5a85-40f1-a439-d9c2d54c0ca2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:22.943777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa370-5a85-40f1-a439-d9c2d54c0ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:23.010099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f0ffa370-5a85-40f1-a439-d9c2d54c0ca2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:23.011288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f0ffa370-5a85-40f1-a439-d9c2d54c0ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:23.023907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:23.105785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:23.144345 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516137-3b7a-4d90-8876-ab1a7ba0d903 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:23.145949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9b516137-3b7a-4d90-8876-ab1a7ba0d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:23.250736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516137-3b7a-4d90-8876-ab1a7ba0d903 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:23.262886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:23.324598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f57c6-1b06-496b-bd3e-a5dc961aef70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:23.325193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f57c6-1b06-496b-bd3e-a5dc961aef70 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:23.325489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f57c6-1b06-496b-bd3e-a5dc961aef70 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:23.325760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f57c6-1b06-496b-bd3e-a5dc961aef70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:23.327327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-870f57c6-1b06-496b-bd3e-a5dc961aef70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:23.436071 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f57c6-1b06-496b-bd3e-a5dc961aef70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:23.437525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f57c6-1b06-496b-bd3e-a5dc961aef70 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:23.455376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 720/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:25.940967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24751114-2686-4a76-bc6b-638732f642c9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:25.941525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24751114-2686-4a76-bc6b-638732f642c9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:25.941525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24751114-2686-4a76-bc6b-638732f642c9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:25.942943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:25.949482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4a485-4bbd-4096-8e5a-8b160a558463 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:25.950077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4a485-4bbd-4096-8e5a-8b160a558463 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:25.950077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4a485-4bbd-4096-8e5a-8b160a558463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:26.004084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:26.022810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-50c4a485-4bbd-4096-8e5a-8b160a558463 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:26.024021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-50c4a485-4bbd-4096-8e5a-8b160a558463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:26.127760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:26.169068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24751114-2686-4a76-bc6b-638732f642c9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:26.170724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-24751114-2686-4a76-bc6b-638732f642c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:26.283384 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24751114-2686-4a76-bc6b-638732f642c9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:26.325462 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:26.362182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d812d46-7766-45ee-b24d-3b4053dd2df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:26.362801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d812d46-7766-45ee-b24d-3b4053dd2df3 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:26.363083 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d812d46-7766-45ee-b24d-3b4053dd2df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:26.363343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d812d46-7766-45ee-b24d-3b4053dd2df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:26.364959 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1d812d46-7766-45ee-b24d-3b4053dd2df3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:26.484061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d812d46-7766-45ee-b24d-3b4053dd2df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:26.485539 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d812d46-7766-45ee-b24d-3b4053dd2df3 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:26.506864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 728/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:28.635081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbce0d-82c5-4186-b761-e9ccb3df13b9 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:28.635614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbce0d-82c5-4186-b761-e9ccb3df13b9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:28.635614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbce0d-82c5-4186-b761-e9ccb3df13b9 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:28.637020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:28.642714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b4584-412d-4ca7-81ca-4a0d6e0f8bf4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:28.643145 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b4584-412d-4ca7-81ca-4a0d6e0f8bf4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:28.643261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b4584-412d-4ca7-81ca-4a0d6e0f8bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:28.709408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9c1b4584-412d-4ca7-81ca-4a0d6e0f8bf4 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:28.710595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9c1b4584-412d-4ca7-81ca-4a0d6e0f8bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:28.731652 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:28.807425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:28.850126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbce0d-82c5-4186-b761-e9ccb3df13b9 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:28.851660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8efbce0d-82c5-4186-b761-e9ccb3df13b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:28.958730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbce0d-82c5-4186-b761-e9ccb3df13b9 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:28.981017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:29.036032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb2a1c-97e7-4594-95ba-5bf4f725aca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:29.036632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb2a1c-97e7-4594-95ba-5bf4f725aca0 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:29.036905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb2a1c-97e7-4594-95ba-5bf4f725aca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:29.037167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb2a1c-97e7-4594-95ba-5bf4f725aca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:29.038811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-50cb2a1c-97e7-4594-95ba-5bf4f725aca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:29.149205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb2a1c-97e7-4594-95ba-5bf4f725aca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:29.150590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb2a1c-97e7-4594-95ba-5bf4f725aca0 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:29.168417 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 723/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:31.257532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed45dd5-879e-47b0-bd79-852d7cbeeafc None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:31.258095 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed45dd5-879e-47b0-bd79-852d7cbeeafc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:31.258095 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed45dd5-879e-47b0-bd79-852d7cbeeafc None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:31.259451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:31.264906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abe368-4b5c-4bb3-8f61-67c0a06e6b5b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:31.265371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abe368-4b5c-4bb3-8f61-67c0a06e6b5b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:31.265493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abe368-4b5c-4bb3-8f61-67c0a06e6b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:31.333138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:31.335721 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b6abe368-4b5c-4bb3-8f61-67c0a06e6b5b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:31.336956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b6abe368-4b5c-4bb3-8f61-67c0a06e6b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:31.438018 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:31.477109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed45dd5-879e-47b0-bd79-852d7cbeeafc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:31.478710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6ed45dd5-879e-47b0-bd79-852d7cbeeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:31.582585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed45dd5-879e-47b0-bd79-852d7cbeeafc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:31.632766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:31.658337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0458a-0d0c-4c8b-81a7-053e0be01685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:31.659405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0458a-0d0c-4c8b-81a7-053e0be01685 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:31.659405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0458a-0d0c-4c8b-81a7-053e0be01685 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:31.659599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0458a-0d0c-4c8b-81a7-053e0be01685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:31.661594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cad0458a-0d0c-4c8b-81a7-053e0be01685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:31.780945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0458a-0d0c-4c8b-81a7-053e0be01685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:31.782403 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0458a-0d0c-4c8b-81a7-053e0be01685 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:31.802376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 731/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:33.904414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94d692-044b-4c86-89fe-2e202a92a531 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:33.904923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94d692-044b-4c86-89fe-2e202a92a531 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:33.904923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94d692-044b-4c86-89fe-2e202a92a531 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:33.906288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:33.911867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192dfaa-c45e-4a1d-bdd2-f5085b63c2c6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:33.912308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192dfaa-c45e-4a1d-bdd2-f5085b63c2c6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:33.912410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192dfaa-c45e-4a1d-bdd2-f5085b63c2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:33.978306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c192dfaa-c45e-4a1d-bdd2-f5085b63c2c6 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:33.979521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c192dfaa-c45e-4a1d-bdd2-f5085b63c2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:34.009855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:34.076683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:34.120399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94d692-044b-4c86-89fe-2e202a92a531 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:34.121969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ab94d692-044b-4c86-89fe-2e202a92a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:34.226796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94d692-044b-4c86-89fe-2e202a92a531 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:34.255241 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:34.308527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e93f9-94a1-45ba-adef-7d5aebbacb16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:34.309126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e93f9-94a1-45ba-adef-7d5aebbacb16 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:34.309426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e93f9-94a1-45ba-adef-7d5aebbacb16 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:34.309697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e93f9-94a1-45ba-adef-7d5aebbacb16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:34.311281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7c7e93f9-94a1-45ba-adef-7d5aebbacb16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:34.420971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e93f9-94a1-45ba-adef-7d5aebbacb16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:34.422520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e93f9-94a1-45ba-adef-7d5aebbacb16 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:34.442188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 726/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 22:54:36.527995 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3a7f5-ad02-4ccf-8c4f-d448d1c04645 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:36.528564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3a7f5-ad02-4ccf-8c4f-d448d1c04645 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:36.528564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3a7f5-ad02-4ccf-8c4f-d448d1c04645 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:36.529912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:36.535176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b0ba-eb15-4fcc-8ee5-463bc08b8397 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:36.535587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b0ba-eb15-4fcc-8ee5-463bc08b8397 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:36.535745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b0ba-eb15-4fcc-8ee5-463bc08b8397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:36.604262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-cd08b0ba-eb15-4fcc-8ee5-463bc08b8397 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:36.605472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-cd08b0ba-eb15-4fcc-8ee5-463bc08b8397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:36.613669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:36.703781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:36.742318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3a7f5-ad02-4ccf-8c4f-d448d1c04645 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:36.744030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e2a3a7f5-ad02-4ccf-8c4f-d448d1c04645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:36.854472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3a7f5-ad02-4ccf-8c4f-d448d1c04645 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:36.913095 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:36.932196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134e55b-fbdc-4c9c-a42b-ed297114030d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:36.932791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e55b-fbdc-4c9c-a42b-ed297114030d service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:36.933059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e55b-fbdc-4c9c-a42b-ed297114030d service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:36.933344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e55b-fbdc-4c9c-a42b-ed297114030d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:36.934988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a134e55b-fbdc-4c9c-a42b-ed297114030d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:37.059735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134e55b-fbdc-4c9c-a42b-ed297114030d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:37.061159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134e55b-fbdc-4c9c-a42b-ed297114030d service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:37.078881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 734/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:39.160609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77567491-5e7f-4bc6-83cd-26ef7d21bca6 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:39.161213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77567491-5e7f-4bc6-83cd-26ef7d21bca6 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:39.161213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77567491-5e7f-4bc6-83cd-26ef7d21bca6 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:39.162708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:39.168335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a1fb2-0e75-40b4-8a09-8d0848f31236 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:39.168824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a1fb2-0e75-40b4-8a09-8d0848f31236 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:39.168930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a1fb2-0e75-40b4-8a09-8d0848f31236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:39.235298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-614a1fb2-0e75-40b4-8a09-8d0848f31236 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:39.236494 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-614a1fb2-0e75-40b4-8a09-8d0848f31236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:39.274854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:39.334500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:39.372816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77567491-5e7f-4bc6-83cd-26ef7d21bca6 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:39.374692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-77567491-5e7f-4bc6-83cd-26ef7d21bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:39.481174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77567491-5e7f-4bc6-83cd-26ef7d21bca6 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:39.519295 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:39.556341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6946b-0118-469a-801d-a589a4876614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:39.556973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6946b-0118-469a-801d-a589a4876614 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:39.557244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6946b-0118-469a-801d-a589a4876614 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:39.557536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6946b-0118-469a-801d-a589a4876614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:39.559127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b4d6946b-0118-469a-801d-a589a4876614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:39.668715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6946b-0118-469a-801d-a589a4876614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:39.670162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6946b-0118-469a-801d-a589a4876614 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:39.688978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 729/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:41.716319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929e0f2-94c6-4000-8652-ed8937978fa5 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:41.716943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929e0f2-94c6-4000-8652-ed8937978fa5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:41.716943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929e0f2-94c6-4000-8652-ed8937978fa5 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:41.718428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:41.724495 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b9b71-c59f-407c-a5b7-bc6a644203c5 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:41.724946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b9b71-c59f-407c-a5b7-bc6a644203c5 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:41.725049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b9b71-c59f-407c-a5b7-bc6a644203c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:41.793023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-399b9b71-c59f-407c-a5b7-bc6a644203c5 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:41.794274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-399b9b71-c59f-407c-a5b7-bc6a644203c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:41.816132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:41.896957 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:41.934712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929e0f2-94c6-4000-8652-ed8937978fa5 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:41.935902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2929e0f2-94c6-4000-8652-ed8937978fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:42.053616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929e0f2-94c6-4000-8652-ed8937978fa5 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:42.121391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:42.128060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc1b4d-44e9-40c3-8875-b964e111499a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:42.136395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1b4d-44e9-40c3-8875-b964e111499a service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:42.136395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1b4d-44e9-40c3-8875-b964e111499a service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:42.136395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1b4d-44e9-40c3-8875-b964e111499a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:42.136395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dafc1b4d-44e9-40c3-8875-b964e111499a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:42.245545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc1b4d-44e9-40c3-8875-b964e111499a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:42.247310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc1b4d-44e9-40c3-8875-b964e111499a service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:42.265611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 737/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:44.316667 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801ea5-3ba8-4994-98c9-128d271f86bd None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:44.317224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801ea5-3ba8-4994-98c9-128d271f86bd None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:44.317224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801ea5-3ba8-4994-98c9-128d271f86bd None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:44.318678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:54:44.324052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0d7b2-f128-41fd-85a3-468507e25178 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:44.324474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0d7b2-f128-41fd-85a3-468507e25178 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:44.324602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0d7b2-f128-41fd-85a3-468507e25178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:44.390238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-eae0d7b2-f128-41fd-85a3-468507e25178 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:54:44.391440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eae0d7b2-f128-41fd-85a3-468507e25178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:44.440606 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:44.490938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:54:44.527740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79801ea5-3ba8-4994-98c9-128d271f86bd None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:54:44.529260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-79801ea5-3ba8-4994-98c9-128d271f86bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:44.635869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79801ea5-3ba8-4994-98c9-128d271f86bd None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:54:44.683644 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:44.710768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8797c-9831-4829-a71f-2c63aaa8eee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:54:44.711407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8797c-9831-4829-a71f-2c63aaa8eee0 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:54:44.711678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8797c-9831-4829-a71f-2c63aaa8eee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:54:44.711947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8797c-9831-4829-a71f-2c63aaa8eee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:54:44.713607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7ba8797c-9831-4829-a71f-2c63aaa8eee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:54:44.823914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8797c-9831-4829-a71f-2c63aaa8eee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:54:44.825238 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8797c-9831-4829-a71f-2c63aaa8eee0 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:54:44.843989 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 732/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:54:54.489090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=22 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:54:54.841799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=66 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:04.534143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e706d-7c07-44a6-b300-e9dfbfd3020a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:04.535311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e706d-7c07-44a6-b300-e9dfbfd3020a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:04.535311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e706d-7c07-44a6-b300-e9dfbfd3020a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:04.536649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 739/1471] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:55:04.541990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf401c9-0d98-4b36-89a0-56af45f2b005 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:04.542444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf401c9-0d98-4b36-89a0-56af45f2b005 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:04.542578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf401c9-0d98-4b36-89a0-56af45f2b005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:04.610652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-acf401c9-0d98-4b36-89a0-56af45f2b005 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:55:04.611858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-acf401c9-0d98-4b36-89a0-56af45f2b005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:04.709209 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 733/1472] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:55:04.795692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace81a2-d234-40b9-9c6f-48f2a1f729ee None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:04.795974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace81a2-d234-40b9-9c6f-48f2a1f729ee None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:04.796282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace81a2-d234-40b9-9c6f-48f2a1f729ee None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:04.797872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 740/1473] 10.222.0.77 () {54 vars in 967 bytes} [Wed Aug 10 22:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 22:55:04.803991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f1a15-359b-4c14-97c1-544891a9ac50 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:04.804328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f1a15-359b-4c14-97c1-544891a9ac50 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:04.804601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f1a15-359b-4c14-97c1-544891a9ac50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:04.880960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-864f1a15-359b-4c14-97c1-544891a9ac50 None None] MFA Rules not processed for user `6e86be85010d4851a1ce3381832af230`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:55:04.882193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-864f1a15-359b-4c14-97c1-544891a9ac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:04.903013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:04.958786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 734/1474] 10.222.0.77 () {58 vars in 1064 bytes} [Wed Aug 10 22:55:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:55:04.967081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace81a2-d234-40b9-9c6f-48f2a1f729ee None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:55:04.968822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4ace81a2-d234-40b9-9c6f-48f2a1f729ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:05.074165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace81a2-d234-40b9-9c6f-48f2a1f729ee None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:55:05.154738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d29aa-23b2-4a67-a75b-a859789ce89d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e86be85010d4851a1ce3381832af230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:55:05.155336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d29aa-23b2-4a67-a75b-a859789ce89d service glance] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:05.155610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d29aa-23b2-4a67-a75b-a859789ce89d service glance] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:05.155878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d29aa-23b2-4a67-a75b-a859789ce89d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:05.157502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c49d29aa-23b2-4a67-a75b-a859789ce89d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:05.214871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:05.269815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d29aa-23b2-4a67-a75b-a859789ce89d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:55:05.271255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d29aa-23b2-4a67-a75b-a859789ce89d service glance] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:55:05.290398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 741/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 22:55:07.369165 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9cc7-bf20-4070-91d8-2339e660aa7b None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:07.369795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9cc7-bf20-4070-91d8-2339e660aa7b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:07.369795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9cc7-bf20-4070-91d8-2339e660aa7b None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:07.371073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 735/1476] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:55:07.376403 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55202c-f973-4410-8261-d9d69e3d58b6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:07.376845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55202c-f973-4410-8261-d9d69e3d58b6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:07.376961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55202c-f973-4410-8261-d9d69e3d58b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:07.442178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-0b55202c-f973-4410-8261-d9d69e3d58b6 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:55:07.443378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0b55202c-f973-4410-8261-d9d69e3d58b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:07.538651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 742/1477] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:55:07.562110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e9cc7-bf20-4070-91d8-2339e660aa7b None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:55:07.563638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-0c6e9cc7-bf20-4070-91d8-2339e660aa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:07.685589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e9cc7-bf20-4070-91d8-2339e660aa7b None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:55:07.733909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:07.777488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72754444-36dc-48d7-9f5b-37367e387fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:55:07.778087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72754444-36dc-48d7-9f5b-37367e387fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:07.778360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72754444-36dc-48d7-9f5b-37367e387fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:07.778628 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72754444-36dc-48d7-9f5b-37367e387fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:07.779252 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72754444-36dc-48d7-9f5b-37367e387fd7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:55:07.780971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WARNING py.warnings [None req-72754444-36dc-48d7-9f5b-37367e387fd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:07.780971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: warnings.warn(msg) Aug 10 22:55:07.780971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: Aug 10 22:55:07.782428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72754444-36dc-48d7-9f5b-37367e387fd7 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:55:07.802276 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 736/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Wed Aug 10 22:55:07 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 22:55:09.850844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf44e4-89e9-40cd-bdbd-cbaca423d9ea None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:09.851405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf44e4-89e9-40cd-bdbd-cbaca423d9ea None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:09.851405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf44e4-89e9-40cd-bdbd-cbaca423d9ea None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:09.852637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 743/1479] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:55:09.857781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac70be3-c639-410b-ac1e-b0f6257e5701 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:09.858237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac70be3-c639-410b-ac1e-b0f6257e5701 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:09.858350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac70be3-c639-410b-ac1e-b0f6257e5701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:09.923850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7ac70be3-c639-410b-ac1e-b0f6257e5701 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:55:09.925589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7ac70be3-c639-410b-ac1e-b0f6257e5701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:10.022289 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 737/1480] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:55:10.065595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf44e4-89e9-40cd-bdbd-cbaca423d9ea None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:55:10.067108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-98bf44e4-89e9-40cd-bdbd-cbaca423d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:10.076703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:10.211839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf44e4-89e9-40cd-bdbd-cbaca423d9ea None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:55:10.290987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:10.324530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc8a0e-1366-483c-918e-bda1d439fb63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:55:10.325393 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8a0e-1366-483c-918e-bda1d439fb63 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:10.326000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8a0e-1366-483c-918e-bda1d439fb63 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:10.326271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8a0e-1366-483c-918e-bda1d439fb63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:10.327862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bacc8a0e-1366-483c-918e-bda1d439fb63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:10.416113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc8a0e-1366-483c-918e-bda1d439fb63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:55:10.417845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc8a0e-1366-483c-918e-bda1d439fb63 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:55:10.436089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 744/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:55:12.645938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854a879-fa16-4983-8755-2d35ce2598ae None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:12.646461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854a879-fa16-4983-8755-2d35ce2598ae None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:12.646461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854a879-fa16-4983-8755-2d35ce2598ae None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:12.647731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 738/1482] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:55:12.653028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fbd87-5a12-4e15-97ca-afeda7631255 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:12.653498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fbd87-5a12-4e15-97ca-afeda7631255 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:12.653603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fbd87-5a12-4e15-97ca-afeda7631255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:12.720252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-809fbd87-5a12-4e15-97ca-afeda7631255 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:55:12.721499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-809fbd87-5a12-4e15-97ca-afeda7631255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:12.768209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:12.818207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 745/1483] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:55:12.854168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854a879-fa16-4983-8755-2d35ce2598ae None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:55:12.855699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b854a879-fa16-4983-8755-2d35ce2598ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:12.879701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:12.967621 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854a879-fa16-4983-8755-2d35ce2598ae None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:55:13.042169 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ce26-7fe6-41ae-9659-b7d288141b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:55:13.042767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ce26-7fe6-41ae-9659-b7d288141b57 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:13.043042 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ce26-7fe6-41ae-9659-b7d288141b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:13.043307 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ce26-7fe6-41ae-9659-b7d288141b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:13.044889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b035ce26-7fe6-41ae-9659-b7d288141b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:13.118198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:13.151751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035ce26-7fe6-41ae-9659-b7d288141b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:55:13.153170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035ce26-7fe6-41ae-9659-b7d288141b57 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:55:13.171824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 739/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 22:55:15.250715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed62aa-19bf-4a0d-b7bf-17fc36da7e61 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:15.251373 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed62aa-19bf-4a0d-b7bf-17fc36da7e61 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:15.251373 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed62aa-19bf-4a0d-b7bf-17fc36da7e61 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:15.253126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 746/1485] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:55:15.258369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d8d82-dff7-4b52-85b0-3b2e7bd21620 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:15.258887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d8d82-dff7-4b52-85b0-3b2e7bd21620 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:15.259157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d8d82-dff7-4b52-85b0-3b2e7bd21620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:15.326173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-337d8d82-dff7-4b52-85b0-3b2e7bd21620 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:55:15.332749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-337d8d82-dff7-4b52-85b0-3b2e7bd21620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:15.423758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 740/1486] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:55:15.462067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed62aa-19bf-4a0d-b7bf-17fc36da7e61 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:55:15.463651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-39ed62aa-19bf-4a0d-b7bf-17fc36da7e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:15.570489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed62aa-19bf-4a0d-b7bf-17fc36da7e61 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:55:15.642311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:15.644130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305ee06-cb84-43f0-a411-be59dd1d642e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:55:15.644718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ee06-cb84-43f0-a411-be59dd1d642e service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:15.644988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ee06-cb84-43f0-a411-be59dd1d642e service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:15.645248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305ee06-cb84-43f0-a411-be59dd1d642e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:15.646856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d305ee06-cb84-43f0-a411-be59dd1d642e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:15.759904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305ee06-cb84-43f0-a411-be59dd1d642e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:55:15.761376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305ee06-cb84-43f0-a411-be59dd1d642e service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:55:15.779725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 747/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:55:17.993442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e418-8a6b-442c-a00c-abf139dc9827 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:17.994033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e418-8a6b-442c-a00c-abf139dc9827 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:17.994033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9e418-8a6b-442c-a00c-abf139dc9827 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:17.995324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 741/1488] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:55:18.000846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b3786-d791-4d0c-9512-d3a22ea34a08 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:18.001275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b3786-d791-4d0c-9512-d3a22ea34a08 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:18.001425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b3786-d791-4d0c-9512-d3a22ea34a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:18.066017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1e3b3786-d791-4d0c-9512-d3a22ea34a08 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:55:18.067193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1e3b3786-d791-4d0c-9512-d3a22ea34a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:18.119722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:18.162990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 748/1489] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:55:18.204938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e418-8a6b-442c-a00c-abf139dc9827 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:55:18.206483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-62c9e418-8a6b-442c-a00c-abf139dc9827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:18.244289 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:18.312677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9e418-8a6b-442c-a00c-abf139dc9827 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:55:18.384837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa810a4-cc95-431a-b67f-45e2ab083e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:55:18.385454 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa810a4-cc95-431a-b67f-45e2ab083e43 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:18.385725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa810a4-cc95-431a-b67f-45e2ab083e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:18.385989 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa810a4-cc95-431a-b67f-45e2ab083e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:18.387588 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8fa810a4-cc95-431a-b67f-45e2ab083e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:18.473254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:18.501933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa810a4-cc95-431a-b67f-45e2ab083e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:55:18.503792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa810a4-cc95-431a-b67f-45e2ab083e43 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:55:18.522133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 742/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:55:20.896789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f6a68-4285-41ce-a138-a0b2627e9abe None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:20.897333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f6a68-4285-41ce-a138-a0b2627e9abe None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:20.897333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f6a68-4285-41ce-a138-a0b2627e9abe None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:20.898611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 749/1491] 10.222.0.77 () {54 vars in 927 bytes} [Wed Aug 10 22:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:55:20.903904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2bd3f-ffaa-4d0c-b8c8-ae995763b3ca None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:20.904298 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2bd3f-ffaa-4d0c-b8c8-ae995763b3ca None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:20.904544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2bd3f-ffaa-4d0c-b8c8-ae995763b3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:20.969712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-8be2bd3f-ffaa-4d0c-b8c8-ae995763b3ca None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:55:20.970916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8be2bd3f-ffaa-4d0c-b8c8-ae995763b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:21.068451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 743/1492] 10.222.0.77 () {58 vars in 1024 bytes} [Wed Aug 10 22:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:55:21.108175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f6a68-4285-41ce-a138-a0b2627e9abe None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:55:21.109742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-890f6a68-4285-41ce-a138-a0b2627e9abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:21.213715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f6a68-4285-41ce-a138-a0b2627e9abe None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:55:21.288310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b094a-4a84-4fe3-9039-04508cae353f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:55:21.288908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b094a-4a84-4fe3-9039-04508cae353f service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:55:21.289179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b094a-4a84-4fe3-9039-04508cae353f service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:55:21.289479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b094a-4a84-4fe3-9039-04508cae353f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:55:21.291089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-085b094a-4a84-4fe3-9039-04508cae353f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:55:21.301180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:21.401860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b094a-4a84-4fe3-9039-04508cae353f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:55:21.403591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b094a-4a84-4fe3-9039-04508cae353f service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:55:21.421729 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 750/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:55:31.066423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=82 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:31.419467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=50 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:41.796856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f98254-4709-4db0-9ce1-f8ba0b3bd5ae None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:41.797595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f98254-4709-4db0-9ce1-f8ba0b3bd5ae None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:41.797595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f98254-4709-4db0-9ce1-f8ba0b3bd5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:41.877572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-83f98254-4709-4db0-9ce1-f8ba0b3bd5ae None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:56:41.878673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-83f98254-4709-4db0-9ce1-f8ba0b3bd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:41.972959 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 744/1494] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 22:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:56:41.981045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9b12-3666-4800-b5fe-9062aca9f23e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:41.981567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9b12-3666-4800-b5fe-9062aca9f23e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:41.981672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9b12-3666-4800-b5fe-9062aca9f23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:42.055814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5a5b9b12-3666-4800-b5fe-9062aca9f23e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:56:42.057019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5a5b9b12-3666-4800-b5fe-9062aca9f23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:42.153631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 751/1495] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 22:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:56:42.158853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f98254-4709-4db0-9ce1-f8ba0b3bd5ae None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:56:42.160038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-83f98254-4709-4db0-9ce1-f8ba0b3bd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:42.171143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f98254-4709-4db0-9ce1-f8ba0b3bd5ae None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:56:42.231193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:42.263154 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:56:42.263790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:42.264062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:42.264321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:42.264944 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 22:56:42.265236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:56:42.266249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WARNING py.warnings [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:42.266249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: warnings.warn(msg) Aug 10 22:56:42.266249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: Aug 10 22:56:42.267184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:56:42.279045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 745/1496] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 22:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:56:42.288193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b9b12-3666-4800-b5fe-9062aca9f23e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:56:42.297247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b9b12-3666-4800-b5fe-9062aca9f23e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:56:42.357648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:42.390577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c285037-2e08-49b1-9894-8014f11be478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:56:42.391173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285037-2e08-49b1-9894-8014f11be478 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:42.391445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285037-2e08-49b1-9894-8014f11be478 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:42.391711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c285037-2e08-49b1-9894-8014f11be478 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:42.392319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c285037-2e08-49b1-9894-8014f11be478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:56:42.394572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-1c285037-2e08-49b1-9894-8014f11be478 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:42.394572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: warnings.warn(msg) Aug 10 22:56:42.394572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: Aug 10 22:56:42.395745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c285037-2e08-49b1-9894-8014f11be478 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:56:42.511045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 752/1497] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 22:56:42 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:56:42.515408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:56:42.516948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:42.551598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c276c-6db1-4d21-bc5c-850a757989f4 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:56:42.645956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f7dd3-0037-48a0-8c54-78d49c47d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:56:42.646537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7dd3-0037-48a0-8c54-78d49c47d47e admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:42.646809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7dd3-0037-48a0-8c54-78d49c47d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:42.647076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7dd3-0037-48a0-8c54-78d49c47d47e admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:42.647741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f7dd3-0037-48a0-8c54-78d49c47d47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:56:42.648714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WARNING py.warnings [None req-f66f7dd3-0037-48a0-8c54-78d49c47d47e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:42.648714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: warnings.warn(msg) Aug 10 22:56:42.648714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: Aug 10 22:56:42.649891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f7dd3-0037-48a0-8c54-78d49c47d47e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:56:42.768555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 746/1498] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 22:56:42 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 22:56:42.772694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c285037-2e08-49b1-9894-8014f11be478 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:56:42.774309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1c285037-2e08-49b1-9894-8014f11be478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:42.836788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c285037-2e08-49b1-9894-8014f11be478 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:56:42.920224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:42.931323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60053-ad38-4765-af76-a1233b3ef435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:56:42.932012 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60053-ad38-4765-af76-a1233b3ef435 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:42.932247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60053-ad38-4765-af76-a1233b3ef435 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:42.932515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c60053-ad38-4765-af76-a1233b3ef435 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:42.933166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60053-ad38-4765-af76-a1233b3ef435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:56:42.934186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-01c60053-ad38-4765-af76-a1233b3ef435 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:42.934186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: warnings.warn(msg) Aug 10 22:56:42.934186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: Aug 10 22:56:42.935066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c60053-ad38-4765-af76-a1233b3ef435 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:56:42.947293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 753/1499] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 22:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 22:56:42.951441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f7dd3-0037-48a0-8c54-78d49c47d47e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:56:42.952941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f66f7dd3-0037-48a0-8c54-78d49c47d47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:42.964763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f7dd3-0037-48a0-8c54-78d49c47d47e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:56:42.990230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:43.058322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be1679-1fbc-41d6-934d-7d6712770712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:56:43.058839 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be1679-1fbc-41d6-934d-7d6712770712 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:43.059108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be1679-1fbc-41d6-934d-7d6712770712 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:43.059369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be1679-1fbc-41d6-934d-7d6712770712 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:43.060002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be1679-1fbc-41d6-934d-7d6712770712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:56:43.061004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WARNING py.warnings [None req-e1be1679-1fbc-41d6-934d-7d6712770712 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:43.061004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: warnings.warn(msg) Aug 10 22:56:43.061004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: Aug 10 22:56:43.061909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be1679-1fbc-41d6-934d-7d6712770712 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:56:43.074587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 747/1500] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 22:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 22:56:43.078757 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60053-ad38-4765-af76-a1233b3ef435 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:56:43.080383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-01c60053-ad38-4765-af76-a1233b3ef435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:43.115246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c60053-ad38-4765-af76-a1233b3ef435 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:56:43.207806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae8193-4c4d-4802-8924-88b910adc089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:56:43.208453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae8193-4c4d-4802-8924-88b910adc089 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:43.208728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae8193-4c4d-4802-8924-88b910adc089 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:43.208999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae8193-4c4d-4802-8924-88b910adc089 admin admin] PATH_INFO: `/v3/projects/f70bb7579fbc4f578bdd7cf9b47bb2d5/users/6906d068ed8742de9b1904da05ef76b2/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:43.230972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae8193-4c4d-4802-8924-88b910adc089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70bb7579fbc4f578bdd7cf9b47bb2d5, user_id=6906d068ed8742de9b1904da05ef76b2, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:56:43.231988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-9aae8193-4c4d-4802-8924-88b910adc089 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:43.231988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: warnings.warn(msg) Aug 10 22:56:43.231988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: Aug 10 22:56:43.233962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae8193-4c4d-4802-8924-88b910adc089 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:56:43.311768 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 754/1501] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 22:56:43 2022] PUT /identity/v3/projects/f70bb7579fbc4f578bdd7cf9b47bb2d5/users/6906d068ed8742de9b1904da05ef76b2/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:56:43.324148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220a795-8d16-4397-b902-5451b7548964 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:43.324430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220a795-8d16-4397-b902-5451b7548964 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:43.324701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220a795-8d16-4397-b902-5451b7548964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:43.383536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-1220a795-8d16-4397-b902-5451b7548964 None None] MFA Rules not processed for user `6906d068ed8742de9b1904da05ef76b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:56:43.384743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1220a795-8d16-4397-b902-5451b7548964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:43.460281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 748/1502] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 22:56:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:56:43.473793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dc879-15ae-4361-af15-1c6cb9d8fec7 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:43.474170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dc879-15ae-4361-af15-1c6cb9d8fec7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:43.474441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dc879-15ae-4361-af15-1c6cb9d8fec7 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:43.475754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 755/1503] 10.222.0.77 () {54 vars in 964 bytes} [Wed Aug 10 22:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:56:43.480639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957bd22-d2c0-4705-be60-cc9af8cdd04b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:43.480923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957bd22-d2c0-4705-be60-cc9af8cdd04b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:43.481196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957bd22-d2c0-4705-be60-cc9af8cdd04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:43.511876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:43.556097 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c957bd22-d2c0-4705-be60-cc9af8cdd04b None None] MFA Rules not processed for user `3eca4101d5a74563855c7fa3dcf1ccc0`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:56:43.557325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c957bd22-d2c0-4705-be60-cc9af8cdd04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:43.632688 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 749/1504] 10.222.0.77 () {58 vars in 1061 bytes} [Wed Aug 10 22:56:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:56:43.640658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dc879-15ae-4361-af15-1c6cb9d8fec7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:56:43.642194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-159dc879-15ae-4361-af15-1c6cb9d8fec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:43.690968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:43.749068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dc879-15ae-4361-af15-1c6cb9d8fec7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:56:43.827564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2dd84-25b7-4dec-bd12-e12b58748af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:56:43.828163 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2dd84-25b7-4dec-bd12-e12b58748af1 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:43.828439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2dd84-25b7-4dec-bd12-e12b58748af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:43.828710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2dd84-25b7-4dec-bd12-e12b58748af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:43.830360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aeb2dd84-25b7-4dec-bd12-e12b58748af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:43.928543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2dd84-25b7-4dec-bd12-e12b58748af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:56:43.929920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2dd84-25b7-4dec-bd12-e12b58748af1 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:56:43.933365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:43.948500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 756/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:56:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:56:43.994909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718148a-ee82-48f1-bafa-44697d9d0411 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:43.995324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718148a-ee82-48f1-bafa-44697d9d0411 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:43.995437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718148a-ee82-48f1-bafa-44697d9d0411 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:43.996635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 750/1506] 10.222.0.77 () {52 vars in 830 bytes} [Wed Aug 10 22:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:56:44.000385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2dd84-25b7-4dec-bd12-e12b58748af1 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:56:44.001609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aeb2dd84-25b7-4dec-bd12-e12b58748af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:44.099696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2dd84-25b7-4dec-bd12-e12b58748af1 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:56:44.193625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:56:44.194175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:44.194495 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:44.194741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] PATH_INFO: `/v3/users/6906d068ed8742de9b1904da05ef76b2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:44.208512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6906d068ed8742de9b1904da05ef76b2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:56:44.209571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:44.209571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: warnings.warn(msg) Aug 10 22:56:44.209571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: Aug 10 22:56:44.210785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:56:44.220723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:44.410270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6906d068ed8742de9b1904da05ef76b2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 22:56:44.434254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6906d068ed8742de9b1904da05ef76b2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 22:56:44.434832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6906d068ed8742de9b1904da05ef76b2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 22:56:44.435257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6906d068ed8742de9b1904da05ef76b2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 22:56:44.520439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6906d068ed8742de9b1904da05ef76b2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 22:56:44.540545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 757/1507] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 22:56:43 2022] DELETE /identity/v3/users/6906d068ed8742de9b1904da05ef76b2 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:56:44.544946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fb0bd-38c7-4e64-8ba5-dc0eed8a4c7d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:44.545232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fb0bd-38c7-4e64-8ba5-dc0eed8a4c7d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:44.545549 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fb0bd-38c7-4e64-8ba5-dc0eed8a4c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:44.602274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-dd0fb0bd-38c7-4e64-8ba5-dc0eed8a4c7d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:56:44.603455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-dd0fb0bd-38c7-4e64-8ba5-dc0eed8a4c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:44.680639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:44.692648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 751/1508] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 22:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:56:44.702989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:56:44.704193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:44.804098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f0972-71fa-42bc-92d7-968dbbe83286 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:56:44.858984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:44.878312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cb6a6-8845-4c7b-81a0-80f8d16d142a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:56:44.878943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb6a6-8845-4c7b-81a0-80f8d16d142a service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:44.879314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb6a6-8845-4c7b-81a0-80f8d16d142a service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:44.879501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb6a6-8845-4c7b-81a0-80f8d16d142a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:44.881237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d48cb6a6-8845-4c7b-81a0-80f8d16d142a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:44.988704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cb6a6-8845-4c7b-81a0-80f8d16d142a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:56:44.990234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cb6a6-8845-4c7b-81a0-80f8d16d142a service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:56:45.008661 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 758/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:56:45.511660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fb0bd-38c7-4e64-8ba5-dc0eed8a4c7d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:56:45.512874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-dd0fb0bd-38c7-4e64-8ba5-dc0eed8a4c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:56:45.524703 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fb0bd-38c7-4e64-8ba5-dc0eed8a4c7d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:56:45.620527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:56:45.621191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:56:45.621444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:56:45.621707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] PATH_INFO: `/v3/projects/f70bb7579fbc4f578bdd7cf9b47bb2d5` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:56:45.631445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70bb7579fbc4f578bdd7cf9b47bb2d5)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:56:45.632448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WARNING py.warnings [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:45.632448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: warnings.warn(msg) Aug 10 22:56:45.632448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: Aug 10 22:56:45.633652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:56:45.761813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70bb7579fbc4f578bdd7cf9b47bb2d5', 'request_id': 'req-12f656d5-8571-4c01-9cfc-040f6356b0d8'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 22:56:45.774578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70bb7579fbc4f578bdd7cf9b47bb2d5', 'request_id': 'req-12f656d5-8571-4c01-9cfc-040f6356b0d8'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 22:56:45.841670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70bb7579fbc4f578bdd7cf9b47bb2d5', 'request_id': 'req-12f656d5-8571-4c01-9cfc-040f6356b0d8'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 22:56:45.869577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] The token cache is being invalidate because project f70bb7579fbc4f578bdd7cf9b47bb2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 22:56:45.869865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 22:56:45.870284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-12f656d5-8571-4c01-9cfc-040f6356b0d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 22:56:45.871713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 752/1510] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 22:56:45 2022] DELETE /identity/v3/projects/f70bb7579fbc4f578bdd7cf9b47bb2d5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 22:56:55.006425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=62 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:55.867332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:19.114451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c790b6-a096-4efc-aa27-6021a2eb8d9a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:19.115082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c790b6-a096-4efc-aa27-6021a2eb8d9a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:19.115082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c790b6-a096-4efc-aa27-6021a2eb8d9a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:19.116282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:58:19.121020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41debc-ecb4-41ee-8f7b-3434be697cd1 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:19.121478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41debc-ecb4-41ee-8f7b-3434be697cd1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:19.121619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41debc-ecb4-41ee-8f7b-3434be697cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:19.200494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7b41debc-ecb4-41ee-8f7b-3434be697cd1 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:58:19.201709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7b41debc-ecb4-41ee-8f7b-3434be697cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:19.304760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 22:58:19.455936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c790b6-a096-4efc-aa27-6021a2eb8d9a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:58:19.458032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-08c790b6-a096-4efc-aa27-6021a2eb8d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:19.577206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c790b6-a096-4efc-aa27-6021a2eb8d9a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:58:19.583281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69966f-7f76-4581-a53c-f4dfc62d77b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:58:19.583878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69966f-7f76-4581-a53c-f4dfc62d77b1 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:19.584153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69966f-7f76-4581-a53c-f4dfc62d77b1 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:19.584424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69966f-7f76-4581-a53c-f4dfc62d77b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:19.592310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69966f-7f76-4581-a53c-f4dfc62d77b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:58:19.593917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69966f-7f76-4581-a53c-f4dfc62d77b1 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:58:19.603762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 760/1513] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:58:20.431079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d007c5-264b-4c15-8e13-882ed43352e4 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:20.431597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d007c5-264b-4c15-8e13-882ed43352e4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:20.431597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d007c5-264b-4c15-8e13-882ed43352e4 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:20.432886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:58:20.437803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9bd42-224b-4400-8d6b-8fd90b3dbe6a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:20.438196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9bd42-224b-4400-8d6b-8fd90b3dbe6a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:20.438358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9bd42-224b-4400-8d6b-8fd90b3dbe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:20.457926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-aac9bd42-224b-4400-8d6b-8fd90b3dbe6a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:58:20.459110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aac9bd42-224b-4400-8d6b-8fd90b3dbe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:20.467088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:58:20.620226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d007c5-264b-4c15-8e13-882ed43352e4 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:58:20.635019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d007c5-264b-4c15-8e13-882ed43352e4 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:58:20.640444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a041a17-a400-4931-aeb7-32752d5b20ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:58:20.641032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a041a17-a400-4931-aeb7-32752d5b20ec service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:20.641328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a041a17-a400-4931-aeb7-32752d5b20ec service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:20.641601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a041a17-a400-4931-aeb7-32752d5b20ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:20.649472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a041a17-a400-4931-aeb7-32752d5b20ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:58:20.651029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a041a17-a400-4931-aeb7-32752d5b20ec service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:58:20.660193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 755/1516] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:58:21.360782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efe372-a775-437f-bed9-81c08ca51013 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:21.361013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efe372-a775-437f-bed9-81c08ca51013 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:21.361282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efe372-a775-437f-bed9-81c08ca51013 None None] PATH_INFO: `/v3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:21.362598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 762/1517] 10.222.0.64 () {54 vars in 925 bytes} [Wed Aug 10 22:58:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 22:58:21.368498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe20b53-3e3a-4d55-9a17-e2ed3ba40173 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:21.368770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe20b53-3e3a-4d55-9a17-e2ed3ba40173 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:21.369032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe20b53-3e3a-4d55-9a17-e2ed3ba40173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:21.428962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ebe20b53-3e3a-4d55-9a17-e2ed3ba40173 None None] MFA Rules not processed for user `6d9439b0577446f1ae9ff61a23df4143`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:58:21.430185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ebe20b53-3e3a-4d55-9a17-e2ed3ba40173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:21.447438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:21.500867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 756/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Aug 10 22:58:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:58:25.703104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36fc03-3db0-4d14-9648-d963bfc4b618 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:25.703680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36fc03-3db0-4d14-9648-d963bfc4b618 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:25.703680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36fc03-3db0-4d14-9648-d963bfc4b618 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:25.704876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 763/1519] 10.222.0.77 () {54 vars in 961 bytes} [Wed Aug 10 22:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:58:25.710301 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503339a5-cc80-4049-ae95-ea344bdc8a28 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:25.710736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503339a5-cc80-4049-ae95-ea344bdc8a28 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:25.710835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503339a5-cc80-4049-ae95-ea344bdc8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:25.730099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-503339a5-cc80-4049-ae95-ea344bdc8a28 None None] MFA Rules not processed for user `6d9439b0577446f1ae9ff61a23df4143`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:58:25.731263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-503339a5-cc80-4049-ae95-ea344bdc8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:25.740187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 757/1520] 10.222.0.77 () {58 vars in 1058 bytes} [Wed Aug 10 22:58:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:58:25.747513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36fc03-3db0-4d14-9648-d963bfc4b618 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:58:25.761252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36fc03-3db0-4d14-9648-d963bfc4b618 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:58:25.766219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a2868-01d7-4d22-a85e-50ae1c9bc48c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:58:25.766799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2868-01d7-4d22-a85e-50ae1c9bc48c service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:25.767076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2868-01d7-4d22-a85e-50ae1c9bc48c service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:25.767347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a2868-01d7-4d22-a85e-50ae1c9bc48c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:25.775873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a2868-01d7-4d22-a85e-50ae1c9bc48c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:58:25.777879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a2868-01d7-4d22-a85e-50ae1c9bc48c service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:58:25.787618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 764/1521] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:58:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:58:31.878507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd59d8e-f760-4729-8b65-5bf2d27e179a None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:31.879027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd59d8e-f760-4729-8b65-5bf2d27e179a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:31.879027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd59d8e-f760-4729-8b65-5bf2d27e179a None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:31.880920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:58:31.885869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb433ec-9619-455a-9b33-ecff5ab6c060 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:31.886284 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb433ec-9619-455a-9b33-ecff5ab6c060 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:31.886445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb433ec-9619-455a-9b33-ecff5ab6c060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:31.905170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ecb433ec-9619-455a-9b33-ecff5ab6c060 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:58:31.906382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ecb433ec-9619-455a-9b33-ecff5ab6c060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:31.914676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:58:32.067241 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd59d8e-f760-4729-8b65-5bf2d27e179a None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:58:32.081172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd59d8e-f760-4729-8b65-5bf2d27e179a None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:58:32.086618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa2639-60ac-4d96-bffa-b2b748e822e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:58:32.087206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa2639-60ac-4d96-bffa-b2b748e822e4 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:32.087547 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa2639-60ac-4d96-bffa-b2b748e822e4 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:32.087812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa2639-60ac-4d96-bffa-b2b748e822e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:32.095834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa2639-60ac-4d96-bffa-b2b748e822e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:58:32.097410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa2639-60ac-4d96-bffa-b2b748e822e4 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:58:32.107003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 759/1524] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:58:32.929801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea045e-430b-420e-8478-58f3d44d9a91 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:32.930330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea045e-430b-420e-8478-58f3d44d9a91 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:32.930330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea045e-430b-420e-8478-58f3d44d9a91 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:32.931647 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 22:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:58:32.936333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1dae3-7523-4625-9b52-90e70eaf8db0 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:32.936732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1dae3-7523-4625-9b52-90e70eaf8db0 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:32.936882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1dae3-7523-4625-9b52-90e70eaf8db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:32.956321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-64b1dae3-7523-4625-9b52-90e70eaf8db0 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:58:32.957525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-64b1dae3-7523-4625-9b52-90e70eaf8db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:32.965796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 22:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:58:33.117724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea045e-430b-420e-8478-58f3d44d9a91 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:58:33.132588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea045e-430b-420e-8478-58f3d44d9a91 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:58:33.138065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fad332-fceb-4e90-b8b8-2ac99140de2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:58:33.138651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fad332-fceb-4e90-b8b8-2ac99140de2a service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:33.138927 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fad332-fceb-4e90-b8b8-2ac99140de2a service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:33.139202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fad332-fceb-4e90-b8b8-2ac99140de2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:33.147125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fad332-fceb-4e90-b8b8-2ac99140de2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:58:33.148720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fad332-fceb-4e90-b8b8-2ac99140de2a service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:58:33.157882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 767/1527] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:58:36.960070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6c832-8559-4a84-b623-b2080adf0be8 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:36.960594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6c832-8559-4a84-b623-b2080adf0be8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:36.960594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6c832-8559-4a84-b623-b2080adf0be8 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:36.961924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:58:36.966820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eea60-74a6-4ff7-b289-cf658e0e9c88 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:36.967260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eea60-74a6-4ff7-b289-cf658e0e9c88 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:36.967358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151eea60-74a6-4ff7-b289-cf658e0e9c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:36.986851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-151eea60-74a6-4ff7-b289-cf658e0e9c88 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:58:36.988035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-151eea60-74a6-4ff7-b289-cf658e0e9c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:36.995728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:58:37.067042 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6c832-8559-4a84-b623-b2080adf0be8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:58:37.068719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-18c6c832-8559-4a84-b623-b2080adf0be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:37.146988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6c832-8559-4a84-b623-b2080adf0be8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:58:37.150524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228748e-9f76-447a-a8c2-869b6f94f37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:58:37.151119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228748e-9f76-447a-a8c2-869b6f94f37b service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:37.151390 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228748e-9f76-447a-a8c2-869b6f94f37b service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:37.151655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228748e-9f76-447a-a8c2-869b6f94f37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:37.160291 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228748e-9f76-447a-a8c2-869b6f94f37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:58:37.161766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228748e-9f76-447a-a8c2-869b6f94f37b service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:58:37.170767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 762/1530] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:58:39.153843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590dcc-b218-4c83-ac32-44da13853edc None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:39.154432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590dcc-b218-4c83-ac32-44da13853edc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:39.154432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590dcc-b218-4c83-ac32-44da13853edc None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:39.155710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:58:39.160938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d219e3-2817-46d1-a08e-963c0a5fc151 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:39.161379 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d219e3-2817-46d1-a08e-963c0a5fc151 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:39.161513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d219e3-2817-46d1-a08e-963c0a5fc151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:39.180903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-13d219e3-2817-46d1-a08e-963c0a5fc151 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:58:39.182123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-13d219e3-2817-46d1-a08e-963c0a5fc151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:39.189847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:58:39.225955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590dcc-b218-4c83-ac32-44da13853edc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:58:39.236653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590dcc-b218-4c83-ac32-44da13853edc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:58:39.240793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec4b222-7a9f-42ff-a94c-1196174b93cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:58:39.241427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4b222-7a9f-42ff-a94c-1196174b93cd service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:39.241707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4b222-7a9f-42ff-a94c-1196174b93cd service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:39.242108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4b222-7a9f-42ff-a94c-1196174b93cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:39.250875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4b222-7a9f-42ff-a94c-1196174b93cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:58:39.252312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec4b222-7a9f-42ff-a94c-1196174b93cd service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:58:39.262129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 770/1533] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:58:42.779954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e1fe5-8273-400e-bef3-8d52031e8488 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:42.780485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e1fe5-8273-400e-bef3-8d52031e8488 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:42.780485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e1fe5-8273-400e-bef3-8d52031e8488 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:42.781864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:58:42.786852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ad58d-58d1-4fd8-ba28-c09942f35b3d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:42.790011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ad58d-58d1-4fd8-ba28-c09942f35b3d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:42.790011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ad58d-58d1-4fd8-ba28-c09942f35b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:42.807038 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6b8ad58d-58d1-4fd8-ba28-c09942f35b3d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:58:42.808200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6b8ad58d-58d1-4fd8-ba28-c09942f35b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:42.815888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:58:43.121499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e1fe5-8273-400e-bef3-8d52031e8488 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:58:43.123162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a28e1fe5-8273-400e-bef3-8d52031e8488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:43.188489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:43.201215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e1fe5-8273-400e-bef3-8d52031e8488 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:58:43.204751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01f08d-5491-4964-a8b7-eaa5499483ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:58:43.205376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01f08d-5491-4964-a8b7-eaa5499483ea service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:43.205655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01f08d-5491-4964-a8b7-eaa5499483ea service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:43.205924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01f08d-5491-4964-a8b7-eaa5499483ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:43.214636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01f08d-5491-4964-a8b7-eaa5499483ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:58:43.216035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01f08d-5491-4964-a8b7-eaa5499483ea service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:58:43.226207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 765/1536] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:58:45.231861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129765e-686d-434c-b35a-18393117b5e9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:45.232489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129765e-686d-434c-b35a-18393117b5e9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:45.232489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129765e-686d-434c-b35a-18393117b5e9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:45.233869 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 22:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 22:58:45.239032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1f59-97fc-4ee2-bd68-9490d126cb01 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:45.239473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1f59-97fc-4ee2-bd68-9490d126cb01 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:45.239575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da1f59-97fc-4ee2-bd68-9490d126cb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:45.258799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-97da1f59-97fc-4ee2-bd68-9490d126cb01 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 22:58:45.259988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-97da1f59-97fc-4ee2-bd68-9490d126cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:45.267727 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 22:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 22:58:45.563150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129765e-686d-434c-b35a-18393117b5e9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 22:58:45.564791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f129765e-686d-434c-b35a-18393117b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 22:58:45.572705 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=84 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:45.578312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129765e-686d-434c-b35a-18393117b5e9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 22:58:45.581813 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc0a41-61a9-4180-a354-91efd3bd179e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 22:58:45.583055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0a41-61a9-4180-a354-91efd3bd179e service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 22:58:45.583305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0a41-61a9-4180-a354-91efd3bd179e service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 22:58:45.583570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc0a41-61a9-4180-a354-91efd3bd179e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 22:58:45.592106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc0a41-61a9-4180-a354-91efd3bd179e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 22:58:45.596154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc0a41-61a9-4180-a354-91efd3bd179e service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 22:58:45.602713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 773/1539] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 22:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 22:58:55.254153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=11 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:55.619434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:16.977746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133a37-68da-4334-8aea-aa8b824e6133 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:16.985932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133a37-68da-4334-8aea-aa8b824e6133 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:16.985932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3133a37-68da-4334-8aea-aa8b824e6133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.000529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-a3133a37-68da-4334-8aea-aa8b824e6133 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:17.002194 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a3133a37-68da-4334-8aea-aa8b824e6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:17.011433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 767/1540] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:00:17.029673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0612e9-28a0-44fe-81bb-7583343ac23b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.030232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0612e9-28a0-44fe-81bb-7583343ac23b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.030232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0612e9-28a0-44fe-81bb-7583343ac23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.055752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1c0612e9-28a0-44fe-81bb-7583343ac23b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:17.056866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1c0612e9-28a0-44fe-81bb-7583343ac23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:17.065936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 774/1541] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:17.070685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133a37-68da-4334-8aea-aa8b824e6133 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:17.085419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3133a37-68da-4334-8aea-aa8b824e6133 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:17.091969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa4723-b569-4298-88e2-a8c8ef994101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:17.092838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa4723-b569-4298-88e2-a8c8ef994101 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.093603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa4723-b569-4298-88e2-a8c8ef994101 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.094188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa4723-b569-4298-88e2-a8c8ef994101 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.095040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa4723-b569-4298-88e2-a8c8ef994101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:17.095525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa4723-b569-4298-88e2-a8c8ef994101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:17.097333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa4723-b569-4298-88e2-a8c8ef994101 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:17.111431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 768/1542] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:00:17.119850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0612e9-28a0-44fe-81bb-7583343ac23b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:17.133585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0612e9-28a0-44fe-81bb-7583343ac23b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:17.141109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b3b14-4015-4f9d-8dfb-c36905f4049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:17.141825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3b14-4015-4f9d-8dfb-c36905f4049d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.142111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3b14-4015-4f9d-8dfb-c36905f4049d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.142583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3b14-4015-4f9d-8dfb-c36905f4049d admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.143229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b3b14-4015-4f9d-8dfb-c36905f4049d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:17.145125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b3b14-4015-4f9d-8dfb-c36905f4049d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:17.238819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 775/1543] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:17 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:17.246018 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa4723-b569-4298-88e2-a8c8ef994101 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:17.261686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa4723-b569-4298-88e2-a8c8ef994101 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:17.332037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a5d1e-c645-4931-a243-6a97581f6dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:17.332575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a5d1e-c645-4931-a243-6a97581f6dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.332853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a5d1e-c645-4931-a243-6a97581f6dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.333729 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a5d1e-c645-4931-a243-6a97581f6dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.334594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a5d1e-c645-4931-a243-6a97581f6dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:17.336842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a5d1e-c645-4931-a243-6a97581f6dd7 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:17.476431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 769/1544] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:17 2022] POST /identity/v3/users => generated 296 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:17.481015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b3b14-4015-4f9d-8dfb-c36905f4049d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:17.494361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b3b14-4015-4f9d-8dfb-c36905f4049d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:17.503839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9000d7-3964-455c-9dcc-5a6c2be13200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:17.503839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9000d7-3964-455c-9dcc-5a6c2be13200 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.503839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9000d7-3964-455c-9dcc-5a6c2be13200 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.503839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9000d7-3964-455c-9dcc-5a6c2be13200 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.504354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9000d7-3964-455c-9dcc-5a6c2be13200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:17.506710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9000d7-3964-455c-9dcc-5a6c2be13200 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:17.521849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 776/1545] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:17.526108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a5d1e-c645-4931-a243-6a97581f6dd7 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:17.541381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a5d1e-c645-4931-a243-6a97581f6dd7 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:17.547146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca5890-85c5-4696-878d-18123de1caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:17.548002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca5890-85c5-4696-878d-18123de1caf1 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.548587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca5890-85c5-4696-878d-18123de1caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.549275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca5890-85c5-4696-878d-18123de1caf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.554214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca5890-85c5-4696-878d-18123de1caf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:17.554214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca5890-85c5-4696-878d-18123de1caf1 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:17.572582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 770/1546] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:17.576313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9000d7-3964-455c-9dcc-5a6c2be13200 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:17.586314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3f18-a8fd-4a49-a7ff-e26b055219f1 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.586518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3f18-a8fd-4a49-a7ff-e26b055219f1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.586771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3f18-a8fd-4a49-a7ff-e26b055219f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.592535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9000d7-3964-455c-9dcc-5a6c2be13200 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:17.602534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff26091-4a82-40ac-a2f0-ff06c34197ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:17.603222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff26091-4a82-40ac-a2f0-ff06c34197ab admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.603501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff26091-4a82-40ac-a2f0-ff06c34197ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.603775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff26091-4a82-40ac-a2f0-ff06c34197ab admin admin] PATH_INFO: `/v3/projects/530d3235232a48c6b61fb3b54e03c11c/users/6cbf62d3f1b44cf582da2659ef133e30/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.637447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-5f3b3f18-a8fd-4a49-a7ff-e26b055219f1 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:17.638669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5f3b3f18-a8fd-4a49-a7ff-e26b055219f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:17.641743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff26091-4a82-40ac-a2f0-ff06c34197ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=530d3235232a48c6b61fb3b54e03c11c, user_id=6cbf62d3f1b44cf582da2659ef133e30, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:17.644406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff26091-4a82-40ac-a2f0-ff06c34197ab admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:17.657235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 771/1547] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:17.667147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca51dd-76d8-461a-8051-020b591120ca None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.669618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca51dd-76d8-461a-8051-020b591120ca None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.669618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca51dd-76d8-461a-8051-020b591120ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.694359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-60ca51dd-76d8-461a-8051-020b591120ca None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:17.702592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-60ca51dd-76d8-461a-8051-020b591120ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:17.706221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 772/1548] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:00:17.714275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca51dd-76d8-461a-8051-020b591120ca None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:17.730416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 777/1549] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:17 2022] PUT /identity/v3/projects/530d3235232a48c6b61fb3b54e03c11c/users/6cbf62d3f1b44cf582da2659ef133e30/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:00:17.732704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca51dd-76d8-461a-8051-020b591120ca None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:17.736452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd66248-2f5e-4d1c-886c-a800628e3aba None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.736740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd66248-2f5e-4d1c-886c-a800628e3aba None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.737013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd66248-2f5e-4d1c-886c-a800628e3aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.782388 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bbd66248-2f5e-4d1c-886c-a800628e3aba None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:17.783601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bbd66248-2f5e-4d1c-886c-a800628e3aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:17.835374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1f5ea-b1c8-4432-99cb-c40b206d9d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:17.836539 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1f5ea-b1c8-4432-99cb-c40b206d9d9d admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.836747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1f5ea-b1c8-4432-99cb-c40b206d9d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.837003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1f5ea-b1c8-4432-99cb-c40b206d9d9d admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.837751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1f5ea-b1c8-4432-99cb-c40b206d9d9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:17.838049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1f5ea-b1c8-4432-99cb-c40b206d9d9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:17.839941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1f5ea-b1c8-4432-99cb-c40b206d9d9d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:17.857807 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 773/1550] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:17.866084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1f5ea-b1c8-4432-99cb-c40b206d9d9d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:17.877620 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1f5ea-b1c8-4432-99cb-c40b206d9d9d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:17.893521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d3f20-e1f3-4271-b2e8-7403e59997db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:17.894391 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3f20-e1f3-4271-b2e8-7403e59997db admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.894672 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3f20-e1f3-4271-b2e8-7403e59997db admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.894943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3f20-e1f3-4271-b2e8-7403e59997db admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.895616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d3f20-e1f3-4271-b2e8-7403e59997db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:17.897249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WARNING py.warnings [None req-281d3f20-e1f3-4271-b2e8-7403e59997db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:00:17.897249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: warnings.warn(msg) Aug 10 23:00:17.897249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: Aug 10 23:00:17.901329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d3f20-e1f3-4271-b2e8-7403e59997db admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:17.956882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 778/1551] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:17.958511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ce3f-da1d-462c-a952-1a3edced423f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:17.958953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ce3f-da1d-462c-a952-1a3edced423f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:17.959377 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ce3f-da1d-462c-a952-1a3edced423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:17.998604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f482ce3f-da1d-462c-a952-1a3edced423f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.000144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f482ce3f-da1d-462c-a952-1a3edced423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.011080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 779/1552] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.012187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482ce3f-da1d-462c-a952-1a3edced423f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.060122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 774/1553] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:17 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:00:18.061434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b7005-f53a-4aad-88dc-be5d247108f9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.061715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b7005-f53a-4aad-88dc-be5d247108f9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.061982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b7005-f53a-4aad-88dc-be5d247108f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.100195 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-5d8b7005-f53a-4aad-88dc-be5d247108f9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.101628 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5d8b7005-f53a-4aad-88dc-be5d247108f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.132209 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:18.133413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482ce3f-da1d-462c-a952-1a3edced423f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.176139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:18.191358 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 775/1554] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.193788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129d92-ce3e-476d-89b4-f76e76ff6aef None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.194491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129d92-ce3e-476d-89b4-f76e76ff6aef None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.194840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129d92-ce3e-476d-89b4-f76e76ff6aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.204798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731da7bf-c9db-4ba9-b80e-c01ac5cf94ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.205440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731da7bf-c9db-4ba9-b80e-c01ac5cf94ea service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.205715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731da7bf-c9db-4ba9-b80e-c01ac5cf94ea service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.205978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731da7bf-c9db-4ba9-b80e-c01ac5cf94ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.215415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731da7bf-c9db-4ba9-b80e-c01ac5cf94ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.215607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-29129d92-ce3e-476d-89b4-f76e76ff6aef None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.216611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-29129d92-ce3e-476d-89b4-f76e76ff6aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.216838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731da7bf-c9db-4ba9-b80e-c01ac5cf94ea service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.230956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 776/1555] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.230956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29129d92-ce3e-476d-89b4-f76e76ff6aef None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.235423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 780/1556] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:18.237011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569a540-064d-4295-a77b-26caa4af4c30 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.237011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569a540-064d-4295-a77b-26caa4af4c30 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.237195 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569a540-064d-4295-a77b-26caa4af4c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.240841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29129d92-ce3e-476d-89b4-f76e76ff6aef None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.246921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e2d88-fdc0-4341-9109-dbd3376f4344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.247536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2d88-fdc0-4341-9109-dbd3376f4344 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.247811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2d88-fdc0-4341-9109-dbd3376f4344 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.248081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2d88-fdc0-4341-9109-dbd3376f4344 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.248703 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e2d88-fdc0-4341-9109-dbd3376f4344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.250830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e2d88-fdc0-4341-9109-dbd3376f4344 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.257019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2569a540-064d-4295-a77b-26caa4af4c30 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.258405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2569a540-064d-4295-a77b-26caa4af4c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.266782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 781/1557] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.268014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1f786-b8ae-49f2-911d-91f3930d7006 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.268289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1f786-b8ae-49f2-911d-91f3930d7006 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.268553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1f786-b8ae-49f2-911d-91f3930d7006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.287609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-18b1f786-b8ae-49f2-911d-91f3930d7006 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.288760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-18b1f786-b8ae-49f2-911d-91f3930d7006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.296617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 782/1558] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.301838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f7edb-311e-4114-856b-7ead7b26db3d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.301838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f7edb-311e-4114-856b-7ead7b26db3d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.301838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f7edb-311e-4114-856b-7ead7b26db3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.317340 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e47f7edb-311e-4114-856b-7ead7b26db3d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.318490 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e47f7edb-311e-4114-856b-7ead7b26db3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.326259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 783/1559] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.327377 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5426f-1f19-4a04-9312-2fef38c9150c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.327731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5426f-1f19-4a04-9312-2fef38c9150c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.327975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5426f-1f19-4a04-9312-2fef38c9150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.348346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b6d5426f-1f19-4a04-9312-2fef38c9150c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.350063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b6d5426f-1f19-4a04-9312-2fef38c9150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.358023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 784/1560] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.358734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5426f-1f19-4a04-9312-2fef38c9150c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.367376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 777/1561] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:18.368707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4ae7-84b0-49b7-9775-f470dee5e394 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.368840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5426f-1f19-4a04-9312-2fef38c9150c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.369039 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4ae7-84b0-49b7-9775-f470dee5e394 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.369253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c4ae7-84b0-49b7-9775-f470dee5e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.373639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d30d7-b3b5-4a1b-b47d-39749728a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.374358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d30d7-b3b5-4a1b-b47d-39749728a0aa admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.374637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d30d7-b3b5-4a1b-b47d-39749728a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.374839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d30d7-b3b5-4a1b-b47d-39749728a0aa admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.375644 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d30d7-b3b5-4a1b-b47d-39749728a0aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:18.375907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d30d7-b3b5-4a1b-b47d-39749728a0aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.376938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-1b5d30d7-b3b5-4a1b-b47d-39749728a0aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:00:18.376938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: warnings.warn(msg) Aug 10 23:00:18.376938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: Aug 10 23:00:18.377843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d30d7-b3b5-4a1b-b47d-39749728a0aa admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.390458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-d23c4ae7-84b0-49b7-9775-f470dee5e394 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.390669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 785/1562] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:18.391852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f9326-0690-4a13-a2df-24b1526e4842 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.392136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f9326-0690-4a13-a2df-24b1526e4842 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.392407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f9326-0690-4a13-a2df-24b1526e4842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.398870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d23c4ae7-84b0-49b7-9775-f470dee5e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.407665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 778/1563] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.410384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddafb4-000d-4270-82fa-1b5008b32867 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.419574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddafb4-000d-4270-82fa-1b5008b32867 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.419574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddafb4-000d-4270-82fa-1b5008b32867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.419817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-183f9326-0690-4a13-a2df-24b1526e4842 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.419817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-183f9326-0690-4a13-a2df-24b1526e4842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.431874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 786/1564] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.433273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fe19f-f3dd-43cf-93b5-a396761fb26c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.433924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fe19f-f3dd-43cf-93b5-a396761fb26c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.433924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fe19f-f3dd-43cf-93b5-a396761fb26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.444479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-6eddafb4-000d-4270-82fa-1b5008b32867 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.445754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6eddafb4-000d-4270-82fa-1b5008b32867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.454176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 779/1565] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.455210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddafb4-000d-4270-82fa-1b5008b32867 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.458716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2e6fe19f-f3dd-43cf-93b5-a396761fb26c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.460233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2e6fe19f-f3dd-43cf-93b5-a396761fb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.464860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddafb4-000d-4270-82fa-1b5008b32867 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.468840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 787/1566] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.469628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fe19f-f3dd-43cf-93b5-a396761fb26c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.470076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6a01e-62cc-4328-97ad-94bd45bf5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.470673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6a01e-62cc-4328-97ad-94bd45bf5f27 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.470948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6a01e-62cc-4328-97ad-94bd45bf5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.471220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6a01e-62cc-4328-97ad-94bd45bf5f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.471906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6a01e-62cc-4328-97ad-94bd45bf5f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:18.472551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6a01e-62cc-4328-97ad-94bd45bf5f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.474682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6a01e-62cc-4328-97ad-94bd45bf5f27 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.479434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fe19f-f3dd-43cf-93b5-a396761fb26c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.484169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d207e63-9f2f-49d5-b6e8-98ea97fa5ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.484740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d207e63-9f2f-49d5-b6e8-98ea97fa5ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.485011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d207e63-9f2f-49d5-b6e8-98ea97fa5ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.485276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d207e63-9f2f-49d5-b6e8-98ea97fa5ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.485958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d207e63-9f2f-49d5-b6e8-98ea97fa5ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.486466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 780/1567] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:18.487303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6a01e-62cc-4328-97ad-94bd45bf5f27 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.487536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d207e63-9f2f-49d5-b6e8-98ea97fa5ed2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.498225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6a01e-62cc-4328-97ad-94bd45bf5f27 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.504126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 788/1568] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:18.504126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c395ba-8ea1-470e-bdec-3ae1d1baaa08 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.504126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c395ba-8ea1-470e-bdec-3ae1d1baaa08 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.504469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1796a5-6d4b-4440-bf94-4782f14ee25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.504580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c395ba-8ea1-470e-bdec-3ae1d1baaa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.504707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1796a5-6d4b-4440-bf94-4782f14ee25e admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.504707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1796a5-6d4b-4440-bf94-4782f14ee25e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.504707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1796a5-6d4b-4440-bf94-4782f14ee25e admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.505022 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1796a5-6d4b-4440-bf94-4782f14ee25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.507043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1796a5-6d4b-4440-bf94-4782f14ee25e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.523241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-53c395ba-8ea1-470e-bdec-3ae1d1baaa08 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:18.524579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-53c395ba-8ea1-470e-bdec-3ae1d1baaa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:18.532924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 789/1569] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:18.534325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c395ba-8ea1-470e-bdec-3ae1d1baaa08 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.547321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c395ba-8ea1-470e-bdec-3ae1d1baaa08 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.553193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be292b-cece-4fa0-94ff-f6837871cf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.553879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be292b-cece-4fa0-94ff-f6837871cf00 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.554155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be292b-cece-4fa0-94ff-f6837871cf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.554471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be292b-cece-4fa0-94ff-f6837871cf00 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.555110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be292b-cece-4fa0-94ff-f6837871cf00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:18.555407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be292b-cece-4fa0-94ff-f6837871cf00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.557031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be292b-cece-4fa0-94ff-f6837871cf00 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.570779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 790/1570] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:18.571478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be292b-cece-4fa0-94ff-f6837871cf00 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.587845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be292b-cece-4fa0-94ff-f6837871cf00 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.592589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c826bb-4b61-4342-8bf0-e518642c6175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.593189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c826bb-4b61-4342-8bf0-e518642c6175 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.593750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c826bb-4b61-4342-8bf0-e518642c6175 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.594023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c826bb-4b61-4342-8bf0-e518642c6175 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.594661 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c826bb-4b61-4342-8bf0-e518642c6175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:18.594962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c826bb-4b61-4342-8bf0-e518642c6175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.596547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c826bb-4b61-4342-8bf0-e518642c6175 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.613382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 791/1571] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:18.613382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c826bb-4b61-4342-8bf0-e518642c6175 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.613675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 781/1572] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:18.613675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1796a5-6d4b-4440-bf94-4782f14ee25e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.625641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c826bb-4b61-4342-8bf0-e518642c6175 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.680246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1796a5-6d4b-4440-bf94-4782f14ee25e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.685188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135b42d-cfce-457f-bc09-ecdc05020d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.685829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b42d-cfce-457f-bc09-ecdc05020d48 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.686115 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b42d-cfce-457f-bc09-ecdc05020d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.686370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b42d-cfce-457f-bc09-ecdc05020d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.686982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135b42d-cfce-457f-bc09-ecdc05020d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.687507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb33e-4f95-49e9-88ab-58b3bf5e546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.688126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb33e-4f95-49e9-88ab-58b3bf5e546a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.688436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb33e-4f95-49e9-88ab-58b3bf5e546a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.688673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cb33e-4f95-49e9-88ab-58b3bf5e546a admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.689111 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135b42d-cfce-457f-bc09-ecdc05020d48 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.689370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb33e-4f95-49e9-88ab-58b3bf5e546a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:18.695322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb33e-4f95-49e9-88ab-58b3bf5e546a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.695322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cb33e-4f95-49e9-88ab-58b3bf5e546a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.703389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 792/1573] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:18.704119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb33e-4f95-49e9-88ab-58b3bf5e546a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.714673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cb33e-4f95-49e9-88ab-58b3bf5e546a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.719783 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7605d1-20c3-43f0-b90a-e36858f31ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.720502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7605d1-20c3-43f0-b90a-e36858f31ecb admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.720733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7605d1-20c3-43f0-b90a-e36858f31ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.721005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7605d1-20c3-43f0-b90a-e36858f31ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.721675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7605d1-20c3-43f0-b90a-e36858f31ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.724436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7605d1-20c3-43f0-b90a-e36858f31ecb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.734793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 793/1574] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:18.735453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7605d1-20c3-43f0-b90a-e36858f31ecb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.745410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7605d1-20c3-43f0-b90a-e36858f31ecb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.752769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd29c6-0ba8-4c04-852a-3a38dc5c776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.752769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd29c6-0ba8-4c04-852a-3a38dc5c776f admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.752769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd29c6-0ba8-4c04-852a-3a38dc5c776f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.752769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd29c6-0ba8-4c04-852a-3a38dc5c776f admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.753167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd29c6-0ba8-4c04-852a-3a38dc5c776f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:18.753167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd29c6-0ba8-4c04-852a-3a38dc5c776f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.753562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd29c6-0ba8-4c04-852a-3a38dc5c776f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.765483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 794/1575] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:18.766459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd29c6-0ba8-4c04-852a-3a38dc5c776f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.781778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd29c6-0ba8-4c04-852a-3a38dc5c776f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.782429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf8e71-ebfb-4186-bb7e-c952cfbd6f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.783034 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf8e71-ebfb-4186-bb7e-c952cfbd6f23 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.783311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf8e71-ebfb-4186-bb7e-c952cfbd6f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.783577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf8e71-ebfb-4186-bb7e-c952cfbd6f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.784256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf8e71-ebfb-4186-bb7e-c952cfbd6f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.786872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf8e71-ebfb-4186-bb7e-c952cfbd6f23 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.798836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:18.806786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 782/1576] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:18.807598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135b42d-cfce-457f-bc09-ecdc05020d48 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.849714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:18.883589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135b42d-cfce-457f-bc09-ecdc05020d48 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.888495 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbddd0-c6e7-40f9-a5e6-b6bcaf1dfe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.889104 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbddd0-c6e7-40f9-a5e6-b6bcaf1dfe07 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.889634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbddd0-c6e7-40f9-a5e6-b6bcaf1dfe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.889634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbddd0-c6e7-40f9-a5e6-b6bcaf1dfe07 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:18.891432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbddd0-c6e7-40f9-a5e6-b6bcaf1dfe07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:18.892596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbddd0-c6e7-40f9-a5e6-b6bcaf1dfe07 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:18.931660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 795/1577] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:18.932552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf8e71-ebfb-4186-bb7e-c952cfbd6f23 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:18.993736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf8e71-ebfb-4186-bb7e-c952cfbd6f23 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:18.998574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d34cde-83aa-493c-915b-9ef627419db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:18.999183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d34cde-83aa-493c-915b-9ef627419db7 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:18.999459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d34cde-83aa-493c-915b-9ef627419db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:18.999730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d34cde-83aa-493c-915b-9ef627419db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.000346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d34cde-83aa-493c-915b-9ef627419db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.002311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d34cde-83aa-493c-915b-9ef627419db7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.012015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 783/1578] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:19.016500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbddd0-c6e7-40f9-a5e6-b6bcaf1dfe07 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.027230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbddd0-c6e7-40f9-a5e6-b6bcaf1dfe07 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.032022 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b824f-cca7-4654-956e-c4640ac32f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.032734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b824f-cca7-4654-956e-c4640ac32f34 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.033131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b824f-cca7-4654-956e-c4640ac32f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.033538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b824f-cca7-4654-956e-c4640ac32f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.034273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b824f-cca7-4654-956e-c4640ac32f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.036558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b824f-cca7-4654-956e-c4640ac32f34 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.120564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 784/1579] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:19 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:19.121484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b824f-cca7-4654-956e-c4640ac32f34 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.121994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 796/1580] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:18 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:19.123116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d34cde-83aa-493c-915b-9ef627419db7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.188007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d34cde-83aa-493c-915b-9ef627419db7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.188629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b824f-cca7-4654-956e-c4640ac32f34 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.193144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b54880-6f4d-4139-9a68-364ddbd3a2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.195923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013530f-623c-4d01-baa9-41d92921a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.196069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b54880-6f4d-4139-9a68-364ddbd3a2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.196069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b54880-6f4d-4139-9a68-364ddbd3a2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.196265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013530f-623c-4d01-baa9-41d92921a59f admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.196371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b54880-6f4d-4139-9a68-364ddbd3a2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.196469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013530f-623c-4d01-baa9-41d92921a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.196469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013530f-623c-4d01-baa9-41d92921a59f admin admin] PATH_INFO: `/v3/projects/dc1c13ea49cc4e1fae44708204286ab9/users/a0a225c4d1fa495fabbace43fe951494/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.196667 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b54880-6f4d-4139-9a68-364ddbd3a2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.196936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b54880-6f4d-4139-9a68-364ddbd3a2b4 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.209904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013530f-623c-4d01-baa9-41d92921a59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1c13ea49cc4e1fae44708204286ab9, user_id=a0a225c4d1fa495fabbace43fe951494, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.210920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WARNING py.warnings [None req-0013530f-623c-4d01-baa9-41d92921a59f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:00:19.210920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: warnings.warn(msg) Aug 10 23:00:19.210920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: Aug 10 23:00:19.212842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013530f-623c-4d01-baa9-41d92921a59f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.296187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 797/1581] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:19 2022] POST /identity/v3/projects => generated 401 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:19.296187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b54880-6f4d-4139-9a68-364ddbd3a2b4 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.314313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 785/1582] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:19 2022] PUT /identity/v3/projects/dc1c13ea49cc4e1fae44708204286ab9/users/a0a225c4d1fa495fabbace43fe951494/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:19.316692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013530f-623c-4d01-baa9-41d92921a59f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.362249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b54880-6f4d-4139-9a68-364ddbd3a2b4 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.367961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:19.378226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013530f-623c-4d01-baa9-41d92921a59f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.385021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01d342-4d0b-4b90-be3b-9560827ef033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.385712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d342-4d0b-4b90-be3b-9560827ef033 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.388498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d342-4d0b-4b90-be3b-9560827ef033 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.388498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d342-4d0b-4b90-be3b-9560827ef033 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.388498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01d342-4d0b-4b90-be3b-9560827ef033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.388833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01d342-4d0b-4b90-be3b-9560827ef033 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.419028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0d8e5-a112-4244-acaf-939c5c800242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.419721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0d8e5-a112-4244-acaf-939c5c800242 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.420205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0d8e5-a112-4244-acaf-939c5c800242 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.420651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0d8e5-a112-4244-acaf-939c5c800242 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.421675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0d8e5-a112-4244-acaf-939c5c800242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.422740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-64f0d8e5-a112-4244-acaf-939c5c800242 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:00:19.422740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: warnings.warn(msg) Aug 10 23:00:19.422740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: Aug 10 23:00:19.423966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0d8e5-a112-4244-acaf-939c5c800242 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.488037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 786/1583] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:19 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:19.488037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01d342-4d0b-4b90-be3b-9560827ef033 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.495969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01d342-4d0b-4b90-be3b-9560827ef033 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.500433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b864a-11b2-446a-a3ee-969a9adaa71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.501002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b864a-11b2-446a-a3ee-969a9adaa71e admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.501274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b864a-11b2-446a-a3ee-969a9adaa71e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.501571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b864a-11b2-446a-a3ee-969a9adaa71e admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.502191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b864a-11b2-446a-a3ee-969a9adaa71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.503763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b864a-11b2-446a-a3ee-969a9adaa71e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.510748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:19.518476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 798/1584] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:19 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:19.518664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 787/1585] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:19.518664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b864a-11b2-446a-a3ee-969a9adaa71e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.520164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0d8e5-a112-4244-acaf-939c5c800242 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.528333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b864a-11b2-446a-a3ee-969a9adaa71e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.530787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0d8e5-a112-4244-acaf-939c5c800242 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.533637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6460c-aafc-4b2f-bd8a-750cae29352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.534302 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6460c-aafc-4b2f-bd8a-750cae29352d admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.534646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6460c-aafc-4b2f-bd8a-750cae29352d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.535008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6460c-aafc-4b2f-bd8a-750cae29352d admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.535690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6460c-aafc-4b2f-bd8a-750cae29352d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.535887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490145b-832d-4b4f-a0dd-d473b5ffac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.536571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490145b-832d-4b4f-a0dd-d473b5ffac6d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.536913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490145b-832d-4b4f-a0dd-d473b5ffac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.537248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490145b-832d-4b4f-a0dd-d473b5ffac6d admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.537973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490145b-832d-4b4f-a0dd-d473b5ffac6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.538100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6460c-aafc-4b2f-bd8a-750cae29352d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.539990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490145b-832d-4b4f-a0dd-d473b5ffac6d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.662588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 799/1586] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:19 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:19.663185 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490145b-832d-4b4f-a0dd-d473b5ffac6d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.672969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490145b-832d-4b4f-a0dd-d473b5ffac6d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.678259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a3c4d-a89d-41f6-9b45-dfcdd6f03689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.678998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a3c4d-a89d-41f6-9b45-dfcdd6f03689 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.679279 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a3c4d-a89d-41f6-9b45-dfcdd6f03689 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.679554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a3c4d-a89d-41f6-9b45-dfcdd6f03689 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.680178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a3c4d-a89d-41f6-9b45-dfcdd6f03689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.682134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a3c4d-a89d-41f6-9b45-dfcdd6f03689 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.726810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 788/1587] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:19 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:19.728691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182f1c8-1500-49a8-95c5-5a712944bd7f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.728691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182f1c8-1500-49a8-95c5-5a712944bd7f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.728691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182f1c8-1500-49a8-95c5-5a712944bd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.748136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-a182f1c8-1500-49a8-95c5-5a712944bd7f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:19.749381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a182f1c8-1500-49a8-95c5-5a712944bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:19.757205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 789/1588] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:19.758090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182f1c8-1500-49a8-95c5-5a712944bd7f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.767957 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182f1c8-1500-49a8-95c5-5a712944bd7f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.772477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5550b4-f0fa-4777-a124-cd0058a29c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.773074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5550b4-f0fa-4777-a124-cd0058a29c5f admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.773378 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5550b4-f0fa-4777-a124-cd0058a29c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.773648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5550b4-f0fa-4777-a124-cd0058a29c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.774410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5550b4-f0fa-4777-a124-cd0058a29c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.776170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5550b4-f0fa-4777-a124-cd0058a29c5f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.783746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 800/1589] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:19 2022] POST /identity/v3/users => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:19.785938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a3c4d-a89d-41f6-9b45-dfcdd6f03689 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.790486 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 790/1590] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:19.791333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5550b4-f0fa-4777-a124-cd0058a29c5f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.799365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a3c4d-a89d-41f6-9b45-dfcdd6f03689 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.801123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5550b4-f0fa-4777-a124-cd0058a29c5f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.806000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10446b50-362d-419a-8412-e97ca952b312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.806685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10446b50-362d-419a-8412-e97ca952b312 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.806802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44aa95-6347-4149-aa15-71fd03075f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.807113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10446b50-362d-419a-8412-e97ca952b312 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.807386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44aa95-6347-4149-aa15-71fd03075f9a admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.807507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10446b50-362d-419a-8412-e97ca952b312 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.807652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44aa95-6347-4149-aa15-71fd03075f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.807972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44aa95-6347-4149-aa15-71fd03075f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.808348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10446b50-362d-419a-8412-e97ca952b312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.809098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44aa95-6347-4149-aa15-71fd03075f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.810249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44aa95-6347-4149-aa15-71fd03075f9a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.810412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10446b50-362d-419a-8412-e97ca952b312 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.824359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 791/1591] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:19.824359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44aa95-6347-4149-aa15-71fd03075f9a admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.824660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 801/1592] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:19.824660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10446b50-362d-419a-8412-e97ca952b312 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.837436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44aa95-6347-4149-aa15-71fd03075f9a admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.837878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10446b50-362d-419a-8412-e97ca952b312 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.850935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbae693-48de-4a97-a03f-f7306138758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.850935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbae693-48de-4a97-a03f-f7306138758a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.850935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbae693-48de-4a97-a03f-f7306138758a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.850935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbae693-48de-4a97-a03f-f7306138758a admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.851331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbae693-48de-4a97-a03f-f7306138758a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.851331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbae693-48de-4a97-a03f-f7306138758a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.851509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea63a2d-36dd-433d-b291-07da07e05f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.851509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea63a2d-36dd-433d-b291-07da07e05f9c admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.851509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea63a2d-36dd-433d-b291-07da07e05f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.851509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea63a2d-36dd-433d-b291-07da07e05f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.851854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea63a2d-36dd-433d-b291-07da07e05f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.851854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea63a2d-36dd-433d-b291-07da07e05f9c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.867362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 802/1593] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:19.867362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbae693-48de-4a97-a03f-f7306138758a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.867686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 792/1594] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:19.867686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea63a2d-36dd-433d-b291-07da07e05f9c admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.876407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea63a2d-36dd-433d-b291-07da07e05f9c admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.881913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf4256-4b21-4f5d-bd8b-475fe964b480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.882545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf4256-4b21-4f5d-bd8b-475fe964b480 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.882822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf4256-4b21-4f5d-bd8b-475fe964b480 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.883087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf4256-4b21-4f5d-bd8b-475fe964b480 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.883709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf4256-4b21-4f5d-bd8b-475fe964b480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.885611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf4256-4b21-4f5d-bd8b-475fe964b480 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.897278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 793/1595] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:19.900501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf4256-4b21-4f5d-bd8b-475fe964b480 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.909266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf4256-4b21-4f5d-bd8b-475fe964b480 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.914716 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1af7-346b-4b63-bb6b-8eaa80457306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.915315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1af7-346b-4b63-bb6b-8eaa80457306 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.915589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1af7-346b-4b63-bb6b-8eaa80457306 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.915853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1af7-346b-4b63-bb6b-8eaa80457306 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.920341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1af7-346b-4b63-bb6b-8eaa80457306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.920341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa1af7-346b-4b63-bb6b-8eaa80457306 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.926134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbae693-48de-4a97-a03f-f7306138758a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.930054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 794/1596] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:19.931139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1af7-346b-4b63-bb6b-8eaa80457306 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.931432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f80b0f-b175-4b5c-875b-d770814a339f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.932029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f80b0f-b175-4b5c-875b-d770814a339f service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.932308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f80b0f-b175-4b5c-875b-d770814a339f service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.932593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f80b0f-b175-4b5c-875b-d770814a339f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.941846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1af7-346b-4b63-bb6b-8eaa80457306 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.942168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f80b0f-b175-4b5c-875b-d770814a339f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.943680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f80b0f-b175-4b5c-875b-d770814a339f service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.946851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcc6cc-11ff-4cab-b70a-5118db1082b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.947724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcc6cc-11ff-4cab-b70a-5118db1082b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.948123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcc6cc-11ff-4cab-b70a-5118db1082b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.948463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcc6cc-11ff-4cab-b70a-5118db1082b4 admin admin] PATH_INFO: `/v3/projects/058822bcf11647f198f5aa5cade84981/users/9417d050f94243ccb290bb1faf989918/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.954547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 803/1597] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:19.955205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f80b0f-b175-4b5c-875b-d770814a339f service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:19.964841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f80b0f-b175-4b5c-875b-d770814a339f service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:19.968036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcc6cc-11ff-4cab-b70a-5118db1082b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=058822bcf11647f198f5aa5cade84981, user_id=9417d050f94243ccb290bb1faf989918, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.970652 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32afcee-5cfb-4968-8829-e0215a4722e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:19.971025 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32afcee-5cfb-4968-8829-e0215a4722e7 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:19.971302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32afcee-5cfb-4968-8829-e0215a4722e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:19.971637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32afcee-5cfb-4968-8829-e0215a4722e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:19.972463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32afcee-5cfb-4968-8829-e0215a4722e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:19.973129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcc6cc-11ff-4cab-b70a-5118db1082b4 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.975181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32afcee-5cfb-4968-8829-e0215a4722e7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:19.992750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 804/1598] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:19.992750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32afcee-5cfb-4968-8829-e0215a4722e7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:20.001099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32afcee-5cfb-4968-8829-e0215a4722e7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:20.006073 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857eb74c-30be-4b60-a0c8-046fa926d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:20.006753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eb74c-30be-4b60-a0c8-046fa926d99c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.007029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eb74c-30be-4b60-a0c8-046fa926d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.007303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eb74c-30be-4b60-a0c8-046fa926d99c admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.007939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857eb74c-30be-4b60-a0c8-046fa926d99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:20.009619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857eb74c-30be-4b60-a0c8-046fa926d99c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:20.025243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 805/1599] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:20.026246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857eb74c-30be-4b60-a0c8-046fa926d99c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:20.037488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857eb74c-30be-4b60-a0c8-046fa926d99c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:20.041182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 795/1600] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:19 2022] PUT /identity/v3/projects/058822bcf11647f198f5aa5cade84981/users/9417d050f94243ccb290bb1faf989918/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:20.042707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcc6cc-11ff-4cab-b70a-5118db1082b4 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:20.075237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:20.140216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcc6cc-11ff-4cab-b70a-5118db1082b4 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:20.146112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164cdc0-8172-4917-8266-9a9e4716b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:20.148385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164cdc0-8172-4917-8266-9a9e4716b936 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.148385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164cdc0-8172-4917-8266-9a9e4716b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.148949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164cdc0-8172-4917-8266-9a9e4716b936 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.149622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164cdc0-8172-4917-8266-9a9e4716b936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:20.151913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164cdc0-8172-4917-8266-9a9e4716b936 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:20.160036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a9a95-738c-4b2b-a932-c1a2a34f9f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:20.163130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a9a95-738c-4b2b-a932-c1a2a34f9f67 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.163519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a9a95-738c-4b2b-a932-c1a2a34f9f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.163890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a9a95-738c-4b2b-a932-c1a2a34f9f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.164612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a9a95-738c-4b2b-a932-c1a2a34f9f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:20.165605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 796/1601] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:20.166545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164cdc0-8172-4917-8266-9a9e4716b936 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:20.167485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a9a95-738c-4b2b-a932-c1a2a34f9f67 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:20.178699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164cdc0-8172-4917-8266-9a9e4716b936 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:20.186363 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb856923-e3e8-461f-bd52-db91d32d1273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:20.187507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 806/1602] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:20.187707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb856923-e3e8-461f-bd52-db91d32d1273 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.188300 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb856923-e3e8-461f-bd52-db91d32d1273 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.188581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb856923-e3e8-461f-bd52-db91d32d1273 admin admin] PATH_INFO: `/v3/projects/7a6aab5394214e2fa112576a28598f68/users/5f8353e92dc54d08ae0a82381d6d619d/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.188714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a9a95-738c-4b2b-a932-c1a2a34f9f67 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:20.204297 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a9a95-738c-4b2b-a932-c1a2a34f9f67 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:20.210199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621d80d-7956-4754-bb95-87e68cf51978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:20.211540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621d80d-7956-4754-bb95-87e68cf51978 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.211777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb856923-e3e8-461f-bd52-db91d32d1273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6aab5394214e2fa112576a28598f68, user_id=5f8353e92dc54d08ae0a82381d6d619d, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:20.212029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621d80d-7956-4754-bb95-87e68cf51978 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.212405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621d80d-7956-4754-bb95-87e68cf51978 admin admin] PATH_INFO: `/v3/projects/fb303e7fe09c4e1a98f7bdcc965de0a1/users/326495f9fdbf4dee8fc559d0a6e47677/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.217463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb856923-e3e8-461f-bd52-db91d32d1273 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:20.230048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621d80d-7956-4754-bb95-87e68cf51978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb303e7fe09c4e1a98f7bdcc965de0a1, user_id=326495f9fdbf4dee8fc559d0a6e47677, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:20.232758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621d80d-7956-4754-bb95-87e68cf51978 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:20.371798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 807/1603] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:20 2022] PUT /identity/v3/projects/fb303e7fe09c4e1a98f7bdcc965de0a1/users/326495f9fdbf4dee8fc559d0a6e47677/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:20.372658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621d80d-7956-4754-bb95-87e68cf51978 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:20.379099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 797/1604] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:20 2022] PUT /identity/v3/projects/7a6aab5394214e2fa112576a28598f68/users/5f8353e92dc54d08ae0a82381d6d619d/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:20.389179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2da16-3e9d-4ca8-b00a-23bd153725df None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.390979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2da16-3e9d-4ca8-b00a-23bd153725df None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.390979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2da16-3e9d-4ca8-b00a-23bd153725df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.455070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-33d2da16-3e9d-4ca8-b00a-23bd153725df None None] MFA Rules not processed for user `9417d050f94243ccb290bb1faf989918`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:20.456613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-33d2da16-3e9d-4ca8-b00a-23bd153725df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:20.469424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621d80d-7956-4754-bb95-87e68cf51978 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:20.488158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:20.571446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8207f-9dc8-4915-94a2-8b4c49dafb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:20.572116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8207f-9dc8-4915-94a2-8b4c49dafb35 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.572490 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8207f-9dc8-4915-94a2-8b4c49dafb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.572772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8207f-9dc8-4915-94a2-8b4c49dafb35 admin admin] PATH_INFO: `/v3/projects/3abe10b2412747d09e07b5ae7a72071f/users/03403068f7da491499f2a62ad218159e/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.670705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 798/1605] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:20.670705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2da16-3e9d-4ca8-b00a-23bd153725df None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:20.684308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8207f-9dc8-4915-94a2-8b4c49dafb35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abe10b2412747d09e07b5ae7a72071f, user_id=03403068f7da491499f2a62ad218159e, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:20.684634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2da16-3e9d-4ca8-b00a-23bd153725df None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:20.684828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8207f-9dc8-4915-94a2-8b4c49dafb35 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:20.684921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80a5c0-f798-4ad6-a872-3cdff8a39e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:20.684921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80a5c0-f798-4ad6-a872-3cdff8a39e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.684921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80a5c0-f798-4ad6-a872-3cdff8a39e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.684921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80a5c0-f798-4ad6-a872-3cdff8a39e74 admin admin] PATH_INFO: `/v3/projects/c958b3da4602415c875456fc70b1e1d7/users/8e51fb3b215e44a3aef4be78eaad3943/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.685217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80a5c0-f798-4ad6-a872-3cdff8a39e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c958b3da4602415c875456fc70b1e1d7, user_id=8e51fb3b215e44a3aef4be78eaad3943, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:20.685217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80a5c0-f798-4ad6-a872-3cdff8a39e74 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:20.702040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 808/1606] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:20 2022] PUT /identity/v3/projects/3abe10b2412747d09e07b5ae7a72071f/users/03403068f7da491499f2a62ad218159e/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:20.706593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8207f-9dc8-4915-94a2-8b4c49dafb35 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:20.729506 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 799/1607] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:20 2022] PUT /identity/v3/projects/c958b3da4602415c875456fc70b1e1d7/users/8e51fb3b215e44a3aef4be78eaad3943/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:20.729506 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3705b2-c86a-4550-8e85-83bde6584453 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.729506 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3705b2-c86a-4550-8e85-83bde6584453 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.729506 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3705b2-c86a-4550-8e85-83bde6584453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.755969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:20.779379 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-2f3705b2-c86a-4550-8e85-83bde6584453 None None] MFA Rules not processed for user `326495f9fdbf4dee8fc559d0a6e47677`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:20.781835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2f3705b2-c86a-4550-8e85-83bde6584453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:20.815802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8207f-9dc8-4915-94a2-8b4c49dafb35 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:20.875271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 800/1608] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:20.876702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70e04-8b6b-46e4-8470-9b0196d36ad9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.877051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70e04-8b6b-46e4-8470-9b0196d36ad9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.877426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70e04-8b6b-46e4-8470-9b0196d36ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.897650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb46733-3037-4d9c-9e2f-240308001c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:20.898436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46733-3037-4d9c-9e2f-240308001c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.898871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46733-3037-4d9c-9e2f-240308001c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.899155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46733-3037-4d9c-9e2f-240308001c62 admin admin] PATH_INFO: `/v3/projects/2020fe628c444958951305dedabc79d7/users/fa75bab0fdb441b4a7ab4ac07ca6ca30/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.908778 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-48c70e04-8b6b-46e4-8470-9b0196d36ad9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:20.910601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-48c70e04-8b6b-46e4-8470-9b0196d36ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:20.914938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb46733-3037-4d9c-9e2f-240308001c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2020fe628c444958951305dedabc79d7, user_id=fa75bab0fdb441b4a7ab4ac07ca6ca30, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:20.918592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb46733-3037-4d9c-9e2f-240308001c62 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:20.923204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 801/1609] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:20.923204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c70e04-8b6b-46e4-8470-9b0196d36ad9 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:20.932451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c70e04-8b6b-46e4-8470-9b0196d36ad9 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:20.937130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650ca08-b694-4cc2-bc16-f2618171cf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:20.937846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650ca08-b694-4cc2-bc16-f2618171cf65 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:20.938118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650ca08-b694-4cc2-bc16-f2618171cf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:20.938382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650ca08-b694-4cc2-bc16-f2618171cf65 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:20.938999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650ca08-b694-4cc2-bc16-f2618171cf65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:20.941338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650ca08-b694-4cc2-bc16-f2618171cf65 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.008798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 809/1610] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:20 2022] PUT /identity/v3/projects/2020fe628c444958951305dedabc79d7/users/fa75bab0fdb441b4a7ab4ac07ca6ca30/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:21.009607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1940c7-b19c-46e9-9997-00d9b851855e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.009890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1940c7-b19c-46e9-9997-00d9b851855e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.010155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1940c7-b19c-46e9-9997-00d9b851855e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.036032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 802/1611] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:20 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:21.036214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a471a6-e2dc-4c5b-a9c4-87997bb10eeb None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.036558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a471a6-e2dc-4c5b-a9c4-87997bb10eeb None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.036876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a471a6-e2dc-4c5b-a9c4-87997bb10eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.043334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bd1940c7-b19c-46e9-9997-00d9b851855e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:21.044567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bd1940c7-b19c-46e9-9997-00d9b851855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:21.064009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-82a471a6-e2dc-4c5b-a9c4-87997bb10eeb None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:21.065283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-82a471a6-e2dc-4c5b-a9c4-87997bb10eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:21.120693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:21.123978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 810/1612] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:21.124817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1940c7-b19c-46e9-9997-00d9b851855e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.134611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 803/1613] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:21.135625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a471a6-e2dc-4c5b-a9c4-87997bb10eeb None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.136983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-82a471a6-e2dc-4c5b-a9c4-87997bb10eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:21.139882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1940c7-b19c-46e9-9997-00d9b851855e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.145384 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caaa825-d53f-424f-a757-9a5a13f1153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.146280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaa825-d53f-424f-a757-9a5a13f1153f admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.146556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaa825-d53f-424f-a757-9a5a13f1153f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.146823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaa825-d53f-424f-a757-9a5a13f1153f admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.147443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caaa825-d53f-424f-a757-9a5a13f1153f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.149395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caaa825-d53f-424f-a757-9a5a13f1153f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.215501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a471a6-e2dc-4c5b-a9c4-87997bb10eeb None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.220343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e7b59-b1fd-408d-a75e-42ee853214ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.221086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e7b59-b1fd-408d-a75e-42ee853214ec service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.221422 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e7b59-b1fd-408d-a75e-42ee853214ec service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.221695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e7b59-b1fd-408d-a75e-42ee853214ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.236389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e7b59-b1fd-408d-a75e-42ee853214ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.237048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e7b59-b1fd-408d-a75e-42ee853214ec service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.246825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 811/1614] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:21 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:21.248608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc164-200a-4bef-9e14-e025b47df268 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.249129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc164-200a-4bef-9e14-e025b47df268 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.249521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc164-200a-4bef-9e14-e025b47df268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.253472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 804/1615] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:21.254648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e7b59-b1fd-408d-a75e-42ee853214ec service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.265765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e7b59-b1fd-408d-a75e-42ee853214ec service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.315781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-88fbc164-200a-4bef-9e14-e025b47df268 None None] MFA Rules not processed for user `fa75bab0fdb441b4a7ab4ac07ca6ca30`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:21.317862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-88fbc164-200a-4bef-9e14-e025b47df268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:21.361044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:21.366798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197faf8-7b7e-45cb-b247-722c9066c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.367624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197faf8-7b7e-45cb-b247-722c9066c380 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.370316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197faf8-7b7e-45cb-b247-722c9066c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.370701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197faf8-7b7e-45cb-b247-722c9066c380 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.371516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197faf8-7b7e-45cb-b247-722c9066c380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.373688 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197faf8-7b7e-45cb-b247-722c9066c380 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.433455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 812/1616] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:21.434554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbc164-200a-4bef-9e14-e025b47df268 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.491481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbc164-200a-4bef-9e14-e025b47df268 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.495346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d132-af8b-4bc5-ad26-e252017c5363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.498415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d132-af8b-4bc5-ad26-e252017c5363 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.498415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d132-af8b-4bc5-ad26-e252017c5363 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.498415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d132-af8b-4bc5-ad26-e252017c5363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.506687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607d132-af8b-4bc5-ad26-e252017c5363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.508059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607d132-af8b-4bc5-ad26-e252017c5363 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.517891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 813/1617] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:21.522423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d132-af8b-4bc5-ad26-e252017c5363 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.533380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d132-af8b-4bc5-ad26-e252017c5363 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.537667 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf9916-746b-49ec-9821-3031b9a04e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.538311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf9916-746b-49ec-9821-3031b9a04e2d service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.538658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf9916-746b-49ec-9821-3031b9a04e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.539142 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf9916-746b-49ec-9821-3031b9a04e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.555922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 805/1618] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:21 2022] POST /identity/v3/users => generated 291 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:21.558760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197faf8-7b7e-45cb-b247-722c9066c380 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.558903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf9916-746b-49ec-9821-3031b9a04e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.560390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf9916-746b-49ec-9821-3031b9a04e2d service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.571638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 814/1619] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:21.572533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf9916-746b-49ec-9821-3031b9a04e2d service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.580369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197faf8-7b7e-45cb-b247-722c9066c380 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.586927 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a4cea-573d-4ae8-8786-756c53dbf56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.588286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a4cea-573d-4ae8-8786-756c53dbf56d admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.588286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a4cea-573d-4ae8-8786-756c53dbf56d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.588735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a4cea-573d-4ae8-8786-756c53dbf56d admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.589530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a4cea-573d-4ae8-8786-756c53dbf56d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.591822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a4cea-573d-4ae8-8786-756c53dbf56d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.632192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf9916-746b-49ec-9821-3031b9a04e2d service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.639845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7db16-7214-43f9-8592-2f76ebdb6097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.640467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7db16-7214-43f9-8592-2f76ebdb6097 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.640744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7db16-7214-43f9-8592-2f76ebdb6097 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.641014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7db16-7214-43f9-8592-2f76ebdb6097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.653878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7db16-7214-43f9-8592-2f76ebdb6097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.655318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7db16-7214-43f9-8592-2f76ebdb6097 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.664614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 815/1620] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:21.665464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7db16-7214-43f9-8592-2f76ebdb6097 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.677059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7db16-7214-43f9-8592-2f76ebdb6097 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.682785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c741d-6e7d-4c82-9d81-d849711c426d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.689335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c741d-6e7d-4c82-9d81-d849711c426d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.689335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c741d-6e7d-4c82-9d81-d849711c426d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.689335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c741d-6e7d-4c82-9d81-d849711c426d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.689335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c741d-6e7d-4c82-9d81-d849711c426d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.689335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c741d-6e7d-4c82-9d81-d849711c426d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.695273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 806/1621] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:21 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:21.697229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a4cea-573d-4ae8-8786-756c53dbf56d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.699684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 816/1622] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:21.703605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c741d-6e7d-4c82-9d81-d849711c426d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.720618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a4cea-573d-4ae8-8786-756c53dbf56d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.731647 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c741d-6e7d-4c82-9d81-d849711c426d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.735531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6545-030f-4b6c-bdbd-0f4bb1a6b6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.736216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6545-030f-4b6c-bdbd-0f4bb1a6b6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.736487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6545-030f-4b6c-bdbd-0f4bb1a6b6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.736757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb6545-030f-4b6c-bdbd-0f4bb1a6b6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.737428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6545-030f-4b6c-bdbd-0f4bb1a6b6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.739543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb6545-030f-4b6c-bdbd-0f4bb1a6b6b6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.745865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977b6e1-95bf-4ff9-b947-f317d662160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.752516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977b6e1-95bf-4ff9-b947-f317d662160e admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.752516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977b6e1-95bf-4ff9-b947-f317d662160e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.752516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977b6e1-95bf-4ff9-b947-f317d662160e admin admin] PATH_INFO: `/v3/projects/4fc5af41104c482ca79d8d65c599f5b3/users/7b50c608c86d48dd91b839a8ad31267e/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.766079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 807/1623] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:21.769946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6545-030f-4b6c-bdbd-0f4bb1a6b6b6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.788347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977b6e1-95bf-4ff9-b947-f317d662160e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc5af41104c482ca79d8d65c599f5b3, user_id=7b50c608c86d48dd91b839a8ad31267e, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.793174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977b6e1-95bf-4ff9-b947-f317d662160e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.796321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb6545-030f-4b6c-bdbd-0f4bb1a6b6b6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:21.818708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecaee99-c962-4486-8ab6-c0f4dc0d1e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:21.820282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaee99-c962-4486-8ab6-c0f4dc0d1e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:21.820568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaee99-c962-4486-8ab6-c0f4dc0d1e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:21.820842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaee99-c962-4486-8ab6-c0f4dc0d1e2f admin admin] PATH_INFO: `/v3/projects/3bab129b5a6142a4a5ca57df313a41ff/users/8ff7326524f545c2a858c73974fbcbb1/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:21.864550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecaee99-c962-4486-8ab6-c0f4dc0d1e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bab129b5a6142a4a5ca57df313a41ff, user_id=8ff7326524f545c2a858c73974fbcbb1, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:21.871792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecaee99-c962-4486-8ab6-c0f4dc0d1e2f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:21.901918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 817/1624] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:21 2022] PUT /identity/v3/projects/4fc5af41104c482ca79d8d65c599f5b3/users/7b50c608c86d48dd91b839a8ad31267e/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:21.905997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977b6e1-95bf-4ff9-b947-f317d662160e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:21.969946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 808/1625] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:21 2022] PUT /identity/v3/projects/3bab129b5a6142a4a5ca57df313a41ff/users/8ff7326524f545c2a858c73974fbcbb1/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:21.975699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecaee99-c962-4486-8ab6-c0f4dc0d1e2f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:22.068128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977b6e1-95bf-4ff9-b947-f317d662160e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:22.106792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecaee99-c962-4486-8ab6-c0f4dc0d1e2f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:22.121756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43a4f-1412-4669-987b-d1567ff326e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:22.123146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43a4f-1412-4669-987b-d1567ff326e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:22.123557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43a4f-1412-4669-987b-d1567ff326e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:22.123868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43a4f-1412-4669-987b-d1567ff326e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:22.124490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e43a4f-1412-4669-987b-d1567ff326e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:22.126388 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e43a4f-1412-4669-987b-d1567ff326e9 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:22.158755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 809/1626] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:22.167362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43a4f-1412-4669-987b-d1567ff326e9 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:22.185604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43a4f-1412-4669-987b-d1567ff326e9 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:22.202481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db7a65-0414-4640-9bb1-d3673787248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:22.203183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7a65-0414-4640-9bb1-d3673787248c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:22.205182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7a65-0414-4640-9bb1-d3673787248c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:22.205546 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7a65-0414-4640-9bb1-d3673787248c admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:22.206228 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db7a65-0414-4640-9bb1-d3673787248c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:22.210891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db7a65-0414-4640-9bb1-d3673787248c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:22.222263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ac593-b916-4907-b907-af41dd6e5074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:22.225057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac593-b916-4907-b907-af41dd6e5074 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:22.225057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac593-b916-4907-b907-af41dd6e5074 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:22.226206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac593-b916-4907-b907-af41dd6e5074 admin admin] PATH_INFO: `/v3/projects/3bab129b5a6142a4a5ca57df313a41ff/users/8ff7326524f545c2a858c73974fbcbb1/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:22.229720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ac593-b916-4907-b907-af41dd6e5074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bab129b5a6142a4a5ca57df313a41ff, user_id=8ff7326524f545c2a858c73974fbcbb1, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:22.233164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ac593-b916-4907-b907-af41dd6e5074 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:22.233636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 818/1627] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:22.237897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db7a65-0414-4640-9bb1-d3673787248c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:22.250216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 810/1628] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:22 2022] PUT /identity/v3/projects/3bab129b5a6142a4a5ca57df313a41ff/users/8ff7326524f545c2a858c73974fbcbb1/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:22.270109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db7a65-0414-4640-9bb1-d3673787248c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:22.274700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad0ac2-cce8-4c5d-9f85-e5826597f66f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:22.274987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad0ac2-cce8-4c5d-9f85-e5826597f66f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:22.275538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad0ac2-cce8-4c5d-9f85-e5826597f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:22.357032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-bcad0ac2-cce8-4c5d-9f85-e5826597f66f None None] MFA Rules not processed for user `8ff7326524f545c2a858c73974fbcbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:22.358423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bcad0ac2-cce8-4c5d-9f85-e5826597f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:22.419728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:22.443533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9aadf-11fc-48ea-ab5a-ad7996911e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:22.446681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9aadf-11fc-48ea-ab5a-ad7996911e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:22.448508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9aadf-11fc-48ea-ab5a-ad7996911e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:22.450124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9aadf-11fc-48ea-ab5a-ad7996911e9b admin admin] PATH_INFO: `/v3/projects/4fc5af41104c482ca79d8d65c599f5b3/users/7b50c608c86d48dd91b839a8ad31267e/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:22.458498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9aadf-11fc-48ea-ab5a-ad7996911e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc5af41104c482ca79d8d65c599f5b3, user_id=7b50c608c86d48dd91b839a8ad31267e, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:22.461593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9aadf-11fc-48ea-ab5a-ad7996911e9b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:22.510162 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 819/1629] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:22 2022] PUT /identity/v3/projects/4fc5af41104c482ca79d8d65c599f5b3/users/7b50c608c86d48dd91b839a8ad31267e/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:00:22.518770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bdcd8-3dfe-45bb-89e3-0249ae327ca9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:22.524043 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bdcd8-3dfe-45bb-89e3-0249ae327ca9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:22.529466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 811/1630] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:22.530102 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bdcd8-3dfe-45bb-89e3-0249ae327ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:22.533372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad0ac2-cce8-4c5d-9f85-e5826597f66f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:22.586381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6d1bdcd8-3dfe-45bb-89e3-0249ae327ca9 None None] MFA Rules not processed for user `7b50c608c86d48dd91b839a8ad31267e`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:22.587787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6d1bdcd8-3dfe-45bb-89e3-0249ae327ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:22.657412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:22.660380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad0ac2-cce8-4c5d-9f85-e5826597f66f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:22.762312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 820/1631] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:00:22.785215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ec06a-f4ff-4305-b5f5-ed138eb4e640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:22.785215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec06a-f4ff-4305-b5f5-ed138eb4e640 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:22.785215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec06a-f4ff-4305-b5f5-ed138eb4e640 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:22.785215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec06a-f4ff-4305-b5f5-ed138eb4e640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:22.925369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ec06a-f4ff-4305-b5f5-ed138eb4e640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:22.929396 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ec06a-f4ff-4305-b5f5-ed138eb4e640 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:22.946976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 812/1632] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:00:22.974619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bdcd8-3dfe-45bb-89e3-0249ae327ca9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:22.995069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bdcd8-3dfe-45bb-89e3-0249ae327ca9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:23.007475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dc53f-903f-402a-81c2-2c6533e29ccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:23.009573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc53f-903f-402a-81c2-2c6533e29ccd service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:23.014155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc53f-903f-402a-81c2-2c6533e29ccd service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:23.014155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc53f-903f-402a-81c2-2c6533e29ccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:23.037664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dc53f-903f-402a-81c2-2c6533e29ccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:23.045942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dc53f-903f-402a-81c2-2c6533e29ccd service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:23.096876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 821/1633] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:24.334532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ae219-5416-4d5f-a55b-290662d65baa None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:24.335048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ae219-5416-4d5f-a55b-290662d65baa None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:24.335048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ae219-5416-4d5f-a55b-290662d65baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:24.407971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-d39ae219-5416-4d5f-a55b-290662d65baa None None] MFA Rules not processed for user `8e51fb3b215e44a3aef4be78eaad3943`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:24.416428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d39ae219-5416-4d5f-a55b-290662d65baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:24.436026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:24.616701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:24.671625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 813/1634] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:24.676912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dc53f-903f-402a-81c2-2c6533e29ccd service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:24.806987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dc53f-903f-402a-81c2-2c6533e29ccd service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:24.813749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717367fd-a868-4a62-8fa1-df994c05ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:24.814744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717367fd-a868-4a62-8fa1-df994c05ee50 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:24.814744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717367fd-a868-4a62-8fa1-df994c05ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:24.814913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717367fd-a868-4a62-8fa1-df994c05ee50 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:24.815920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717367fd-a868-4a62-8fa1-df994c05ee50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:24.818749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717367fd-a868-4a62-8fa1-df994c05ee50 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:24.823995 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ae219-5416-4d5f-a55b-290662d65baa None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:24.837304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ae219-5416-4d5f-a55b-290662d65baa None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:24.853573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:24.855038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:24.855038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:24.856551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] PATH_INFO: `/v3/users/326495f9fdbf4dee8fc559d0a6e47677` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:24.857930 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=326495f9fdbf4dee8fc559d0a6e47677)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:24.859908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: WARNING py.warnings [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:00:24.859908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: warnings.warn(msg) Aug 10 23:00:24.859908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: Aug 10 23:00:24.861589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:24.995405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 822/1635] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:24 2022] POST /identity/v3/projects => generated 405 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:24.999765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717367fd-a868-4a62-8fa1-df994c05ee50 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:25.173854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '326495f9fdbf4dee8fc559d0a6e47677'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:25.210480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '326495f9fdbf4dee8fc559d0a6e47677'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:25.210607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717367fd-a868-4a62-8fa1-df994c05ee50 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:25.227282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819513fd-17c1-472a-9835-03634816510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:25.227591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819513fd-17c1-472a-9835-03634816510c admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:25.227820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819513fd-17c1-472a-9835-03634816510c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:25.228177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819513fd-17c1-472a-9835-03634816510c admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:25.228681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819513fd-17c1-472a-9835-03634816510c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:25.230648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819513fd-17c1-472a-9835-03634816510c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:25.267162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '326495f9fdbf4dee8fc559d0a6e47677'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:25.268357 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '326495f9fdbf4dee8fc559d0a6e47677'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:25.269588 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6d62dbce-5ccd-49ad-93dc-1bb0168155f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '326495f9fdbf4dee8fc559d0a6e47677'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:25.346755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 823/1636] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:24 2022] POST /identity/v3/users => generated 309 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:25.347782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819513fd-17c1-472a-9835-03634816510c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:25.350488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-819513fd-17c1-472a-9835-03634816510c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:25.368467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 814/1637] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:24 2022] DELETE /identity/v3/users/326495f9fdbf4dee8fc559d0a6e47677 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:25.371846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417e1ac-0e1d-432a-a671-52b098623dee None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:25.372131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417e1ac-0e1d-432a-a671-52b098623dee None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:25.372399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417e1ac-0e1d-432a-a671-52b098623dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:25.375386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819513fd-17c1-472a-9835-03634816510c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:25.433041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e417e1ac-0e1d-432a-a671-52b098623dee None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:25.436441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e417e1ac-0e1d-432a-a671-52b098623dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:25.501325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2184d-0bc8-4312-9d8a-c24db0faf671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:25.502493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2184d-0bc8-4312-9d8a-c24db0faf671 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:25.502790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2184d-0bc8-4312-9d8a-c24db0faf671 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:25.503221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2184d-0bc8-4312-9d8a-c24db0faf671 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:25.504119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2184d-0bc8-4312-9d8a-c24db0faf671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:25.509537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2184d-0bc8-4312-9d8a-c24db0faf671 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:25.541328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 824/1638] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:25.544716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2184d-0bc8-4312-9d8a-c24db0faf671 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:25.571626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2184d-0bc8-4312-9d8a-c24db0faf671 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:25.589524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541cfc8-7df0-4e36-a949-6372aac74c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:25.589524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541cfc8-7df0-4e36-a949-6372aac74c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:25.589793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541cfc8-7df0-4e36-a949-6372aac74c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:25.590090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541cfc8-7df0-4e36-a949-6372aac74c74 admin admin] PATH_INFO: `/v3/projects/c3aee228cec64a9ebede190ecd43d509/users/da7b08aeb6a04a5b82d0d49e4e75d741/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:25.637045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541cfc8-7df0-4e36-a949-6372aac74c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3aee228cec64a9ebede190ecd43d509, user_id=da7b08aeb6a04a5b82d0d49e4e75d741, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:25.639865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541cfc8-7df0-4e36-a949-6372aac74c74 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:25.679724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 815/1639] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:25.679724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417e1ac-0e1d-432a-a671-52b098623dee None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:25.680453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e417e1ac-0e1d-432a-a671-52b098623dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:25.734377 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 825/1640] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:25 2022] PUT /identity/v3/projects/c3aee228cec64a9ebede190ecd43d509/users/da7b08aeb6a04a5b82d0d49e4e75d741/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:25.740992 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541cfc8-7df0-4e36-a949-6372aac74c74 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:25.841678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417e1ac-0e1d-432a-a671-52b098623dee None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:25.891560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541cfc8-7df0-4e36-a949-6372aac74c74 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:25.909861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec713e-1c79-462d-a191-2d2e9af30602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:25.910633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec713e-1c79-462d-a191-2d2e9af30602 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:25.912304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec713e-1c79-462d-a191-2d2e9af30602 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:25.912657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec713e-1c79-462d-a191-2d2e9af30602 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:25.914531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec713e-1c79-462d-a191-2d2e9af30602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:25.916307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec713e-1c79-462d-a191-2d2e9af30602 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:25.950994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:25.968978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 826/1641] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:00:25.986638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec713e-1c79-462d-a191-2d2e9af30602 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:26.025926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec713e-1c79-462d-a191-2d2e9af30602 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:26.044100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb9c4c-3601-4d7d-bc3e-b5a07b1d912b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:26.045988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb9c4c-3601-4d7d-bc3e-b5a07b1d912b service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:26.051549 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb9c4c-3601-4d7d-bc3e-b5a07b1d912b service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:26.051549 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb9c4c-3601-4d7d-bc3e-b5a07b1d912b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:26.059232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cda35-37c5-4e3d-afef-a85787bf8585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:26.060472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cda35-37c5-4e3d-afef-a85787bf8585 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:26.061821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cda35-37c5-4e3d-afef-a85787bf8585 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:26.063881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cda35-37c5-4e3d-afef-a85787bf8585 admin admin] PATH_INFO: `/v3/projects/c3aee228cec64a9ebede190ecd43d509/users/da7b08aeb6a04a5b82d0d49e4e75d741/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:26.072599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cda35-37c5-4e3d-afef-a85787bf8585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3aee228cec64a9ebede190ecd43d509, user_id=da7b08aeb6a04a5b82d0d49e4e75d741, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:26.086565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cda35-37c5-4e3d-afef-a85787bf8585 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:26.093802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb9c4c-3601-4d7d-bc3e-b5a07b1d912b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:26.095648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb9c4c-3601-4d7d-bc3e-b5a07b1d912b service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:26.108637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 827/1642] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:25 2022] PUT /identity/v3/projects/c3aee228cec64a9ebede190ecd43d509/users/da7b08aeb6a04a5b82d0d49e4e75d741/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:26.112562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 816/1643] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:00:26.112725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba50d7-03c9-4d8d-a73a-d44df24c839a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:26.112725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba50d7-03c9-4d8d-a73a-d44df24c839a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:26.112725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba50d7-03c9-4d8d-a73a-d44df24c839a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:26.112972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 828/1644] 10.222.0.77 () {54 vars in 962 bytes} [Wed Aug 10 23:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:00:26.123565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783522b-ebd0-4d6c-8250-69305d3be5b9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:26.123849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783522b-ebd0-4d6c-8250-69305d3be5b9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:26.124148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783522b-ebd0-4d6c-8250-69305d3be5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:26.171463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-4783522b-ebd0-4d6c-8250-69305d3be5b9 None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:26.173221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4783522b-ebd0-4d6c-8250-69305d3be5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:26.264815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 817/1645] 10.222.0.77 () {58 vars in 1059 bytes} [Wed Aug 10 23:00:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:26.270395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56f97-3445-4b2a-befc-2fb5f2fa1add None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:26.270806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56f97-3445-4b2a-befc-2fb5f2fa1add None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:26.271184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe56f97-3445-4b2a-befc-2fb5f2fa1add None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:26.273014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 829/1646] 10.222.0.77 () {54 vars in 912 bytes} [Wed Aug 10 23:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:00:26.280030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a874-a69d-4b9e-ae4a-5c1b715ea341 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:26.280311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a874-a69d-4b9e-ae4a-5c1b715ea341 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:26.280642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a874-a69d-4b9e-ae4a-5c1b715ea341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:26.310169 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-2d08a874-a69d-4b9e-ae4a-5c1b715ea341 None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:26.312292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2d08a874-a69d-4b9e-ae4a-5c1b715ea341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:26.330113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 818/1647] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:00:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:26.337953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe56f97-3445-4b2a-befc-2fb5f2fa1add None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:26.340967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9fe56f97-3445-4b2a-befc-2fb5f2fa1add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:26.486743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe56f97-3445-4b2a-befc-2fb5f2fa1add None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:26.503351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d367a-a4d9-4a33-91e1-d6d2e5b09913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:26.503783 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d367a-a4d9-4a33-91e1-d6d2e5b09913 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:26.504062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d367a-a4d9-4a33-91e1-d6d2e5b09913 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:26.504380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d367a-a4d9-4a33-91e1-d6d2e5b09913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:26.527371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d367a-a4d9-4a33-91e1-d6d2e5b09913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:26.532152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d367a-a4d9-4a33-91e1-d6d2e5b09913 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:26.557911 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 830/1648] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:00:26.775437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:27.994691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08a874-a69d-4b9e-ae4a-5c1b715ea341 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:27.996126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2d08a874-a69d-4b9e-ae4a-5c1b715ea341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:28.155852 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08a874-a69d-4b9e-ae4a-5c1b715ea341 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:28.168179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:28.169101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:28.169571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:28.170002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] PATH_INFO: `/v3/projects/fb303e7fe09c4e1a98f7bdcc965de0a1` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:28.174031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb303e7fe09c4e1a98f7bdcc965de0a1)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:28.178304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:28.341523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb303e7fe09c4e1a98f7bdcc965de0a1', 'request_id': 'req-0766a861-be36-44d7-82d5-cc3aca2150d6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:28.345272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb303e7fe09c4e1a98f7bdcc965de0a1', 'request_id': 'req-0766a861-be36-44d7-82d5-cc3aca2150d6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:28.443521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb303e7fe09c4e1a98f7bdcc965de0a1', 'request_id': 'req-0766a861-be36-44d7-82d5-cc3aca2150d6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:28.463480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] The token cache is being invalidate because project fb303e7fe09c4e1a98f7bdcc965de0a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:28.468876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:28.468876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:28.470973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 819/1649] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:27 2022] DELETE /identity/v3/projects/fb303e7fe09c4e1a98f7bdcc965de0a1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:00:28.475370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d367a-a4d9-4a33-91e1-d6d2e5b09913 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:28.487512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d367a-a4d9-4a33-91e1-d6d2e5b09913 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:28.640355 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:28.641014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:28.641369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:28.641818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] PATH_INFO: `/v3/users/8ff7326524f545c2a858c73974fbcbb1` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:28.644258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff7326524f545c2a858c73974fbcbb1)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:28.650653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:28.679886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:28.689235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:28.719866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766a861-be36-44d7-82d5-cc3aca2150d6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:28.731218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:28.732850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:28.733194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:28.733344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:28.734783 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] PATH_INFO: `/v3/users/9417d050f94243ccb290bb1faf989918` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:28.742516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9417d050f94243ccb290bb1faf989918)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:28.747565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:28.872233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff7326524f545c2a858c73974fbcbb1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:28.920597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff7326524f545c2a858c73974fbcbb1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:28.921823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff7326524f545c2a858c73974fbcbb1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:28.924008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff7326524f545c2a858c73974fbcbb1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:28.993048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9417d050f94243ccb290bb1faf989918'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:29.006903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9417d050f94243ccb290bb1faf989918'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:29.033216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9417d050f94243ccb290bb1faf989918'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:29.039283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9c5f41e-9c47-43bf-bc93-9fef88c0b264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff7326524f545c2a858c73974fbcbb1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:29.046197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9417d050f94243ccb290bb1faf989918'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:29.048458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c89ac36d-d05d-42b2-8264-220f15c9c7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9417d050f94243ccb290bb1faf989918'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:29.059796 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 831/1650] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:28 2022] DELETE /identity/v3/users/8ff7326524f545c2a858c73974fbcbb1 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:29.062742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:29.126829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 820/1651] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:28 2022] DELETE /identity/v3/users/9417d050f94243ccb290bb1faf989918 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:29.126979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370c4d-5ba7-4e10-954c-387c6f685b8f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:29.127146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370c4d-5ba7-4e10-954c-387c6f685b8f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:29.127408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370c4d-5ba7-4e10-954c-387c6f685b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:29.163426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e1370c4d-5ba7-4e10-954c-387c6f685b8f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:29.167805 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e1370c4d-5ba7-4e10-954c-387c6f685b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:29.365237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 832/1652] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:29.366043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c22e33-155c-4349-930d-8dd06f45be49 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:29.366043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c22e33-155c-4349-930d-8dd06f45be49 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:29.366043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c22e33-155c-4349-930d-8dd06f45be49 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:29.366043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 821/1653] 10.222.0.77 () {54 vars in 962 bytes} [Wed Aug 10 23:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:00:29.372487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96e5e-67a5-4cc7-8125-80f66903d903 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:29.372757 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96e5e-67a5-4cc7-8125-80f66903d903 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:29.373039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96e5e-67a5-4cc7-8125-80f66903d903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:29.404556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c22e33-155c-4349-930d-8dd06f45be49 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:29.407665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-10c22e33-155c-4349-930d-8dd06f45be49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:29.420207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b1a96e5e-67a5-4cc7-8125-80f66903d903 None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:29.420207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b1a96e5e-67a5-4cc7-8125-80f66903d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:29.539067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c22e33-155c-4349-930d-8dd06f45be49 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:29.568782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de2440-0ff3-40e5-a233-98ea0f444e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:29.569432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de2440-0ff3-40e5-a233-98ea0f444e35 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:29.569712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de2440-0ff3-40e5-a233-98ea0f444e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:29.569980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de2440-0ff3-40e5-a233-98ea0f444e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:29.578574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:29.599616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de2440-0ff3-40e5-a233-98ea0f444e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:29.602935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de2440-0ff3-40e5-a233-98ea0f444e35 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:29.612938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 833/1654] 10.222.0.77 () {58 vars in 1059 bytes} [Wed Aug 10 23:00:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:29.620526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3661b-be08-4fb8-973a-e171914bbc66 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:29.621032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3661b-be08-4fb8-973a-e171914bbc66 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:29.622016 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3661b-be08-4fb8-973a-e171914bbc66 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:29.623524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 834/1655] 10.222.0.77 () {54 vars in 912 bytes} [Wed Aug 10 23:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:00:29.630501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b03a6-a0a8-4d3b-b632-7b486dd3b91c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:29.632770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b03a6-a0a8-4d3b-b632-7b486dd3b91c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:29.634717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 822/1656] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:00:29.635786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b03a6-a0a8-4d3b-b632-7b486dd3b91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:29.658754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d85b03a6-a0a8-4d3b-b632-7b486dd3b91c None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:29.658754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d85b03a6-a0a8-4d3b-b632-7b486dd3b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:29.674544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 835/1657] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:00:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:29.683985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de2440-0ff3-40e5-a233-98ea0f444e35 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:29.687435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-32de2440-0ff3-40e5-a233-98ea0f444e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:29.719406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:29.722591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f053ac3-559a-4dfc-b0d3-45ffc63f6753 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:29.724147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f053ac3-559a-4dfc-b0d3-45ffc63f6753 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:29.724147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f053ac3-559a-4dfc-b0d3-45ffc63f6753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:29.789938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9f053ac3-559a-4dfc-b0d3-45ffc63f6753 None None] MFA Rules not processed for user `6cbf62d3f1b44cf582da2659ef133e30`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:29.791167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9f053ac3-559a-4dfc-b0d3-45ffc63f6753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:29.858430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de2440-0ff3-40e5-a233-98ea0f444e35 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:29.863379 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02765a-d159-43bd-a4e8-586b8902ee66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:29.864472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02765a-d159-43bd-a4e8-586b8902ee66 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:29.864758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02765a-d159-43bd-a4e8-586b8902ee66 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:29.865375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02765a-d159-43bd-a4e8-586b8902ee66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:29.878052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02765a-d159-43bd-a4e8-586b8902ee66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:29.893026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02765a-d159-43bd-a4e8-586b8902ee66 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:29.908420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 823/1658] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:30.004266 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 836/1659] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:30.004747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83941a06-431d-483e-9515-74b335a75c3b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:30.005240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83941a06-431d-483e-9515-74b335a75c3b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:30.005777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83941a06-431d-483e-9515-74b335a75c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:30.059316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-83941a06-431d-483e-9515-74b335a75c3b None None] MFA Rules not processed for user `6cbf62d3f1b44cf582da2659ef133e30`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:30.061368 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-83941a06-431d-483e-9515-74b335a75c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:30.077375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 824/1660] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:00:30.099586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f053ac3-559a-4dfc-b0d3-45ffc63f6753 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:30.104290 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9f053ac3-559a-4dfc-b0d3-45ffc63f6753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:30.154878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f053ac3-559a-4dfc-b0d3-45ffc63f6753 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:30.170120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bad002-b3c4-4132-92ce-fc0b76f104c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:30.170946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad002-b3c4-4132-92ce-fc0b76f104c8 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:30.171347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad002-b3c4-4132-92ce-fc0b76f104c8 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:30.171738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bad002-b3c4-4132-92ce-fc0b76f104c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:30.192239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad002-b3c4-4132-92ce-fc0b76f104c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:30.195875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bad002-b3c4-4132-92ce-fc0b76f104c8 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:30.217518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 837/1661] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:30.942127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8220b5e-4cf2-4957-b646-68e4482ca558 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:30.942408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8220b5e-4cf2-4957-b646-68e4482ca558 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:30.942680 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8220b5e-4cf2-4957-b646-68e4482ca558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:31.030763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f8220b5e-4cf2-4957-b646-68e4482ca558 None None] MFA Rules not processed for user `da7b08aeb6a04a5b82d0d49e4e75d741`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:31.032011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f8220b5e-4cf2-4957-b646-68e4482ca558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:31.196669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 825/1662] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:30 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:31.826000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1f42-cfb6-4ee3-97f9-a87cc3da885d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:31.826454 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1f42-cfb6-4ee3-97f9-a87cc3da885d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:31.827007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1f42-cfb6-4ee3-97f9-a87cc3da885d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:31.829444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 838/1663] 10.222.0.77 () {54 vars in 912 bytes} [Wed Aug 10 23:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:00:31.835790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb3dd3-b467-489c-94ca-d467b46c993f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:31.836193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb3dd3-b467-489c-94ca-d467b46c993f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:31.836474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb3dd3-b467-489c-94ca-d467b46c993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:31.869823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:31.928593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-33eb3dd3-b467-489c-94ca-d467b46c993f None None] MFA Rules not processed for user `ff5c08bfc5e94b65bd4addde267e4598`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:31.930536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-33eb3dd3-b467-489c-94ca-d467b46c993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:31.942645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 826/1664] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:00:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:32.020445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1f42-cfb6-4ee3-97f9-a87cc3da885d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:32.044870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1f42-cfb6-4ee3-97f9-a87cc3da885d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:32.054954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819788-9cc1-43ee-89f6-ca502a922de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:32.058212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819788-9cc1-43ee-89f6-ca502a922de1 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:32.058664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819788-9cc1-43ee-89f6-ca502a922de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:32.059119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819788-9cc1-43ee-89f6-ca502a922de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:32.094442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6819788-9cc1-43ee-89f6-ca502a922de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:32.098904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6819788-9cc1-43ee-89f6-ca502a922de1 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:32.117042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 839/1665] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:32.748958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb3dd3-b467-489c-94ca-d467b46c993f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:32.750489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-33eb3dd3-b467-489c-94ca-d467b46c993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:32.778837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb3dd3-b467-489c-94ca-d467b46c993f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:32.789502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:32.790214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:32.790498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:32.790772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] PATH_INFO: `/v3/projects/3bab129b5a6142a4a5ca57df313a41ff` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:32.792362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bab129b5a6142a4a5ca57df313a41ff)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:32.797528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:33.105656 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bab129b5a6142a4a5ca57df313a41ff', 'request_id': 'req-7f39d1b3-7bee-4e43-8b5f-60a910e59587'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:33.123208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bab129b5a6142a4a5ca57df313a41ff', 'request_id': 'req-7f39d1b3-7bee-4e43-8b5f-60a910e59587'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:33.194459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bab129b5a6142a4a5ca57df313a41ff', 'request_id': 'req-7f39d1b3-7bee-4e43-8b5f-60a910e59587'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:33.231046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] The token cache is being invalidate because project 3bab129b5a6142a4a5ca57df313a41ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:33.231533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:33.232373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7f39d1b3-7bee-4e43-8b5f-60a910e59587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:33.238430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 827/1666] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:32 2022] DELETE /identity/v3/projects/3bab129b5a6142a4a5ca57df313a41ff => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:33.246917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f66e0-90d4-4a59-adc3-feb3323b7aad None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:33.246917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f66e0-90d4-4a59-adc3-feb3323b7aad None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:33.246917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f66e0-90d4-4a59-adc3-feb3323b7aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:33.258666 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76427-62a7-424f-b312-345a3991a450 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:33.259170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76427-62a7-424f-b312-345a3991a450 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:33.259601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76427-62a7-424f-b312-345a3991a450 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:33.261256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 828/1667] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:00:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:00:33.280409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-450f66e0-90d4-4a59-adc3-feb3323b7aad None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:33.283764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc5e7-d69e-4928-8ca6-8923f13773bb None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:33.283929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-450f66e0-90d4-4a59-adc3-feb3323b7aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:33.284343 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc5e7-d69e-4928-8ca6-8923f13773bb None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:33.284767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdc5e7-d69e-4928-8ca6-8923f13773bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:33.321625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f7fdc5e7-d69e-4928-8ca6-8923f13773bb None None] MFA Rules not processed for user `6d9439b0577446f1ae9ff61a23df4143`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:33.323107 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f7fdc5e7-d69e-4928-8ca6-8923f13773bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:33.471940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 840/1668] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:33.478630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca8025-6d69-4214-b398-be8483b7feaa None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:33.479120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca8025-6d69-4214-b398-be8483b7feaa None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:33.479527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca8025-6d69-4214-b398-be8483b7feaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:33.561967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 829/1669] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:00:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:00:33.567352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-00ca8025-6d69-4214-b398-be8483b7feaa None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:33.574673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-00ca8025-6d69-4214-b398-be8483b7feaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:33.586466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50ceca-21be-4d15-99cc-65da1afa77b3 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:33.586753 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50ceca-21be-4d15-99cc-65da1afa77b3 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:33.587027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50ceca-21be-4d15-99cc-65da1afa77b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:33.617791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 841/1670] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:00:33.618706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca8025-6d69-4214-b398-be8483b7feaa None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:33.628432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-00ca8025-6d69-4214-b398-be8483b7feaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:33.647734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca8025-6d69-4214-b398-be8483b7feaa None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:33.656923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:33.657976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:33.659060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:33.666064 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] PATH_INFO: `/v3/projects/058822bcf11647f198f5aa5cade84981` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:33.668728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=058822bcf11647f198f5aa5cade84981)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:33.670451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:00:33.670451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: warnings.warn(msg) Aug 10 23:00:33.670451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: Aug 10 23:00:33.674063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:33.693509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-eb50ceca-21be-4d15-99cc-65da1afa77b3 None None] MFA Rules not processed for user `a0a225c4d1fa495fabbace43fe951494`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:33.695045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-eb50ceca-21be-4d15-99cc-65da1afa77b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:33.843369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:33.861616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 830/1671] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:33.864589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a57fec-15a0-4e8f-bd4a-b82effd4a1b2 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:33.864701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a57fec-15a0-4e8f-bd4a-b82effd4a1b2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:33.866422 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a57fec-15a0-4e8f-bd4a-b82effd4a1b2 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:33.874140 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 831/1672] 10.222.0.77 () {54 vars in 961 bytes} [Wed Aug 10 23:00:33 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:00:33.875207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a57fec-15a0-4e8f-bd4a-b82effd4a1b2 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:33.923559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:33.940631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '058822bcf11647f198f5aa5cade84981', 'request_id': 'req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:33.966816 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '058822bcf11647f198f5aa5cade84981', 'request_id': 'req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:34.022911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a57fec-15a0-4e8f-bd4a-b82effd4a1b2 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:34.027246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '058822bcf11647f198f5aa5cade84981', 'request_id': 'req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:34.028894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c15efd-8ead-482b-a590-67f6e9f83bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:34.029772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15efd-8ead-482b-a590-67f6e9f83bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:34.033968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15efd-8ead-482b-a590-67f6e9f83bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:34.033968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c15efd-8ead-482b-a590-67f6e9f83bc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:34.033968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c15efd-8ead-482b-a590-67f6e9f83bc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:34.033968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c15efd-8ead-482b-a590-67f6e9f83bc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:34.033968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c15efd-8ead-482b-a590-67f6e9f83bc7 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:34.046990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] The token cache is being invalidate because project 058822bcf11647f198f5aa5cade84981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:34.049496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:34.055117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 832/1673] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:34.055117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c15efd-8ead-482b-a590-67f6e9f83bc7 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:34.055329 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fb17fcc7-4c0f-4c8e-a732-3d29dc46efe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:34.055481 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e0c15efd-8ead-482b-a590-67f6e9f83bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:34.062124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 842/1674] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:33 2022] DELETE /identity/v3/projects/058822bcf11647f198f5aa5cade84981 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:34.065275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e034-beda-4d11-b1ec-1c0243a73682 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:34.068214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e034-beda-4d11-b1ec-1c0243a73682 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:34.068496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e034-beda-4d11-b1ec-1c0243a73682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:34.109357 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e210e034-beda-4d11-b1ec-1c0243a73682 None None] MFA Rules not processed for user `a0a225c4d1fa495fabbace43fe951494`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:34.112160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e210e034-beda-4d11-b1ec-1c0243a73682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:34.215062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c15efd-8ead-482b-a590-67f6e9f83bc7 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:34.239529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1c063-7e63-4779-a212-fb2e066560a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:34.240305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1c063-7e63-4779-a212-fb2e066560a9 service placement] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:34.240686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1c063-7e63-4779-a212-fb2e066560a9 service placement] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:34.241067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1c063-7e63-4779-a212-fb2e066560a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:34.245345 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 843/1675] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:34.245526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fba1c063-7e63-4779-a212-fb2e066560a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:34.250489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01551f2-033f-401e-a484-4f98e08dc16d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:34.251043 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01551f2-033f-401e-a484-4f98e08dc16d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:34.251043 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01551f2-033f-401e-a484-4f98e08dc16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:34.274532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1c063-7e63-4779-a212-fb2e066560a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:34.276709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1c063-7e63-4779-a212-fb2e066560a9 service placement] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:34.294439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e01551f2-033f-401e-a484-4f98e08dc16d None None] MFA Rules not processed for user `6d9439b0577446f1ae9ff61a23df4143`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:34.295771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e01551f2-033f-401e-a484-4f98e08dc16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:34.302679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 833/1676] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:34.304623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0218af-7794-4233-bd8f-3f974e1ae199 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:34.305063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0218af-7794-4233-bd8f-3f974e1ae199 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:34.305651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0218af-7794-4233-bd8f-3f974e1ae199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:34.332662 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-4d0218af-7794-4233-bd8f-3f974e1ae199 None None] MFA Rules not processed for user `6cbf62d3f1b44cf582da2659ef133e30`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:34.334367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4d0218af-7794-4233-bd8f-3f974e1ae199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:34.336341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 844/1677] 10.222.0.77 () {58 vars in 1058 bytes} [Wed Aug 10 23:00:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:34.336840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01551f2-033f-401e-a484-4f98e08dc16d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:34.343425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e01551f2-033f-401e-a484-4f98e08dc16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:34.375716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01551f2-033f-401e-a484-4f98e08dc16d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:34.388473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a47255-6a64-419c-9e20-67654148bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:34.388954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a47255-6a64-419c-9e20-67654148bd59 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:34.389234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a47255-6a64-419c-9e20-67654148bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:34.389539 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a47255-6a64-419c-9e20-67654148bd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:34.390167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a47255-6a64-419c-9e20-67654148bd59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:34.393039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a47255-6a64-419c-9e20-67654148bd59 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:34.502139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 834/1678] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:34.503262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0218af-7794-4233-bd8f-3f974e1ae199 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:34.506387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 845/1679] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:34 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:34.506387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a47255-6a64-419c-9e20-67654148bd59 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:34.512047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a6a47255-6a64-419c-9e20-67654148bd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:34.523701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4d0218af-7794-4233-bd8f-3f974e1ae199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:34.586803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0218af-7794-4233-bd8f-3f974e1ae199 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:34.772684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:34.773667 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:34.773898 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:34.774151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] PATH_INFO: `/v3/users/7b50c608c86d48dd91b839a8ad31267e` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:34.775426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b50c608c86d48dd91b839a8ad31267e)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:34.789324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:34.809072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a47255-6a64-419c-9e20-67654148bd59 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:34.848696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce2ea4-90c8-4cc3-a500-ee9d2a53fa37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:34.854278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce2ea4-90c8-4cc3-a500-ee9d2a53fa37 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:34.854278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce2ea4-90c8-4cc3-a500-ee9d2a53fa37 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:34.854278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce2ea4-90c8-4cc3-a500-ee9d2a53fa37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:34.862390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8cce2ea4-90c8-4cc3-a500-ee9d2a53fa37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:35.009966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:35.052689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce2ea4-90c8-4cc3-a500-ee9d2a53fa37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:35.054520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce2ea4-90c8-4cc3-a500-ee9d2a53fa37 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:35.063177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b50c608c86d48dd91b839a8ad31267e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:35.074005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 846/1680] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:35.075019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce2ea4-90c8-4cc3-a500-ee9d2a53fa37 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:35.111897 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b50c608c86d48dd91b839a8ad31267e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:35.169127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b50c608c86d48dd91b839a8ad31267e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:35.170125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b50c608c86d48dd91b839a8ad31267e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:35.170848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b50c608c86d48dd91b839a8ad31267e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:35.237241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce2ea4-90c8-4cc3-a500-ee9d2a53fa37 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:35.266249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c97f4-70ae-4aae-a8b0-ccac252a089a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:35.266945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c97f4-70ae-4aae-a8b0-ccac252a089a service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:35.267139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c97f4-70ae-4aae-a8b0-ccac252a089a service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:35.267829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c97f4-70ae-4aae-a8b0-ccac252a089a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:35.274174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-966c97f4-70ae-4aae-a8b0-ccac252a089a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:35.281255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 835/1681] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:34 2022] DELETE /identity/v3/users/7b50c608c86d48dd91b839a8ad31267e => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:35.282497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:35.285007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:35.312762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c97f4-70ae-4aae-a8b0-ccac252a089a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:35.314918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c97f4-70ae-4aae-a8b0-ccac252a089a service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:35.338465 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 847/1682] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:35.423973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e84f-2cd9-413d-b7c7-7818c9513285 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:35.445540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bfa9c-79f3-4abc-8471-7b69c6791813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:35.446336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bfa9c-79f3-4abc-8471-7b69c6791813 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:35.446673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bfa9c-79f3-4abc-8471-7b69c6791813 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:35.447213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bfa9c-79f3-4abc-8471-7b69c6791813 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:35.447924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bfa9c-79f3-4abc-8471-7b69c6791813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:35.454906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bfa9c-79f3-4abc-8471-7b69c6791813 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:35.553488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:35.638460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 836/1683] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:35 2022] POST /identity/v3/users => generated 283 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:35.639385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c97f4-70ae-4aae-a8b0-ccac252a089a service placement] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:35.672157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c97f4-70ae-4aae-a8b0-ccac252a089a service placement] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:35.696366 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3a244-ecfe-4fb3-b846-42eed066e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:35.697010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3a244-ecfe-4fb3-b846-42eed066e31a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:35.697312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3a244-ecfe-4fb3-b846-42eed066e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:35.697595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3a244-ecfe-4fb3-b846-42eed066e31a admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:35.698248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3a244-ecfe-4fb3-b846-42eed066e31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:35.699893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3a244-ecfe-4fb3-b846-42eed066e31a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:35.736173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 848/1684] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:00:35.739857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bfa9c-79f3-4abc-8471-7b69c6791813 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:35.754249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bfa9c-79f3-4abc-8471-7b69c6791813 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:35.777585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c49eb-3d3f-4d66-af3a-f75d0fbca6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:35.778227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c49eb-3d3f-4d66-af3a-f75d0fbca6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:35.778510 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c49eb-3d3f-4d66-af3a-f75d0fbca6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:35.778783 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c49eb-3d3f-4d66-af3a-f75d0fbca6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:35.779440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c49eb-3d3f-4d66-af3a-f75d0fbca6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:35.781227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c49eb-3d3f-4d66-af3a-f75d0fbca6b3 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:35.816990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 837/1685] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:35.821470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3a244-ecfe-4fb3-b846-42eed066e31a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:35.840000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3a244-ecfe-4fb3-b846-42eed066e31a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:35.855703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0448d0-4514-4057-ba1c-6fee65dea9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:35.856489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0448d0-4514-4057-ba1c-6fee65dea9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:35.856875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0448d0-4514-4057-ba1c-6fee65dea9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:35.857346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0448d0-4514-4057-ba1c-6fee65dea9c1 admin admin] PATH_INFO: `/v3/projects/e6a2572348544df19978ba422d7eed42/users/7bbde952395040d1bd6bc5673478d7cc/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:35.907136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0448d0-4514-4057-ba1c-6fee65dea9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a2572348544df19978ba422d7eed42, user_id=7bbde952395040d1bd6bc5673478d7cc, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:35.912342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0448d0-4514-4057-ba1c-6fee65dea9c1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:36.078857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 849/1686] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:35 2022] PUT /identity/v3/projects/e6a2572348544df19978ba422d7eed42/users/7bbde952395040d1bd6bc5673478d7cc/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:36.082266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0300ad-9e54-453d-b91a-9891a53b8be8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:36.083107 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0300ad-9e54-453d-b91a-9891a53b8be8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:36.083535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0300ad-9e54-453d-b91a-9891a53b8be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:36.162971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-3c0300ad-9e54-453d-b91a-9891a53b8be8 None None] MFA Rules not processed for user `7bbde952395040d1bd6bc5673478d7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:36.164126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3c0300ad-9e54-453d-b91a-9891a53b8be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:36.201231 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:36.332592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 838/1687] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:36.337563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0448d0-4514-4057-ba1c-6fee65dea9c1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:36.349607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32acb-d62b-4c42-b870-fc1bf4aa6687 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:36.349607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32acb-d62b-4c42-b870-fc1bf4aa6687 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:36.349607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32acb-d62b-4c42-b870-fc1bf4aa6687 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:36.349607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 839/1688] 10.222.0.77 () {54 vars in 912 bytes} [Wed Aug 10 23:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 23:00:36.354311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f8fb-2dd4-4279-b803-05a012ae50d5 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:36.354698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f8fb-2dd4-4279-b803-05a012ae50d5 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:36.355100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f8fb-2dd4-4279-b803-05a012ae50d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:36.383072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9017f8fb-2dd4-4279-b803-05a012ae50d5 None None] MFA Rules not processed for user `ff5c08bfc5e94b65bd4addde267e4598`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:36.384597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9017f8fb-2dd4-4279-b803-05a012ae50d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:36.471481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0448d0-4514-4057-ba1c-6fee65dea9c1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:36.486398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ffc92-1f87-4d07-ac06-d4d8e6f5934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:36.487395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ffc92-1f87-4d07-ac06-d4d8e6f5934b admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:36.487867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ffc92-1f87-4d07-ac06-d4d8e6f5934b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:36.488332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ffc92-1f87-4d07-ac06-d4d8e6f5934b admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:36.489285 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ffc92-1f87-4d07-ac06-d4d8e6f5934b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:36.491389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ffc92-1f87-4d07-ac06-d4d8e6f5934b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:36.575523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 840/1689] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:00:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:00:36.577564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f8fb-2dd4-4279-b803-05a012ae50d5 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:36.580938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9017f8fb-2dd4-4279-b803-05a012ae50d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:36.612856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f8fb-2dd4-4279-b803-05a012ae50d5 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:36.629356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:36.630171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:36.632663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:36.639514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] PATH_INFO: `/v3/users/8e51fb3b215e44a3aef4be78eaad3943` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:36.642153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 850/1690] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:36 2022] POST /identity/v3/projects => generated 365 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:36.646113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e51fb3b215e44a3aef4be78eaad3943)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:36.647328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ffc92-1f87-4d07-ac06-d4d8e6f5934b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:36.651268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:36.848212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ffc92-1f87-4d07-ac06-d4d8e6f5934b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:36.867633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2ba5-ba1a-494f-8c4e-c488a3852cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:36.869831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2ba5-ba1a-494f-8c4e-c488a3852cbb admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:36.869831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2ba5-ba1a-494f-8c4e-c488a3852cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:36.869831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2ba5-ba1a-494f-8c4e-c488a3852cbb admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:36.871343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c2ba5-ba1a-494f-8c4e-c488a3852cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:36.882679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c2ba5-ba1a-494f-8c4e-c488a3852cbb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:36.951831 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e51fb3b215e44a3aef4be78eaad3943'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:36.991147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e51fb3b215e44a3aef4be78eaad3943'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:37.020072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 851/1691] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:36 2022] POST /identity/v3/users => generated 289 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:37.022154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2ba5-ba1a-494f-8c4e-c488a3852cbb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:37.031093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d54c2ba5-ba1a-494f-8c4e-c488a3852cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:37.040047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e51fb3b215e44a3aef4be78eaad3943'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:37.040915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e51fb3b215e44a3aef4be78eaad3943'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:37.041597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e51fb3b215e44a3aef4be78eaad3943'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:37.146156 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 841/1692] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:36 2022] DELETE /identity/v3/users/8e51fb3b215e44a3aef4be78eaad3943 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:37.148709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:37.153818 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:37.165201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:37.263113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2ba5-ba1a-494f-8c4e-c488a3852cbb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:37.388148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261e69e-f1c0-439e-870d-ba453baafb34 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:37.397670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fee110-3cac-48e0-8ceb-e254846f0d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:37.400551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fee110-3cac-48e0-8ceb-e254846f0d83 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:37.400835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fee110-3cac-48e0-8ceb-e254846f0d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:37.401105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fee110-3cac-48e0-8ceb-e254846f0d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:37.405194 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fee110-3cac-48e0-8ceb-e254846f0d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:37.409419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fee110-3cac-48e0-8ceb-e254846f0d83 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:37.434251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 842/1693] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:37.436110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f1e6f-2f2a-4ee3-9568-0f1384bec124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:37.439417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f1e6f-2f2a-4ee3-9568-0f1384bec124 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:37.440158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f1e6f-2f2a-4ee3-9568-0f1384bec124 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:37.442778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f1e6f-2f2a-4ee3-9568-0f1384bec124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:37.442997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fee110-3cac-48e0-8ceb-e254846f0d83 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:37.463120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b5fee110-3cac-48e0-8ceb-e254846f0d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:37.463218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d94f1e6f-2f2a-4ee3-9568-0f1384bec124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:37.475416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f1e6f-2f2a-4ee3-9568-0f1384bec124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:37.477326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f1e6f-2f2a-4ee3-9568-0f1384bec124 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:37.485256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fee110-3cac-48e0-8ceb-e254846f0d83 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:37.487787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 852/1694] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:37.497754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f1e6f-2f2a-4ee3-9568-0f1384bec124 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:37.501873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:37.501873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:37.501873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:37.501873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] PATH_INFO: `/v3/projects/4fc5af41104c482ca79d8d65c599f5b3` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:37.502846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc5af41104c482ca79d8d65c599f5b3)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:37.504823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:37.542270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f1e6f-2f2a-4ee3-9568-0f1384bec124 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:37.550701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07c8d-2e21-47e5-9ade-6160d19b1b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:37.551851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07c8d-2e21-47e5-9ade-6160d19b1b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:37.552342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07c8d-2e21-47e5-9ade-6160d19b1b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:37.554576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07c8d-2e21-47e5-9ade-6160d19b1b22 admin admin] PATH_INFO: `/v3/projects/fc342ee621574ea69e8e6d5961351b10/users/c88253f7b79444f5ae6de800bad30604/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:37.594110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf07c8d-2e21-47e5-9ade-6160d19b1b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc342ee621574ea69e8e6d5961351b10, user_id=c88253f7b79444f5ae6de800bad30604, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:37.600901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf07c8d-2e21-47e5-9ade-6160d19b1b22 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:37.727321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 853/1695] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:37 2022] PUT /identity/v3/projects/fc342ee621574ea69e8e6d5961351b10/users/c88253f7b79444f5ae6de800bad30604/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:37.732581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07c8d-2e21-47e5-9ade-6160d19b1b22 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:37.744510 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc5af41104c482ca79d8d65c599f5b3', 'request_id': 'req-d2a25344-5f11-41fe-a468-2e32fd08a09a'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:37.761130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc5af41104c482ca79d8d65c599f5b3', 'request_id': 'req-d2a25344-5f11-41fe-a468-2e32fd08a09a'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:37.829094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07c8d-2e21-47e5-9ade-6160d19b1b22 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:37.836785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691764-516e-4f30-91d5-6e73b48b5b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:37.838321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691764-516e-4f30-91d5-6e73b48b5b18 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:37.838750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691764-516e-4f30-91d5-6e73b48b5b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:37.839275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691764-516e-4f30-91d5-6e73b48b5b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:37.840401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f691764-516e-4f30-91d5-6e73b48b5b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:37.843709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f691764-516e-4f30-91d5-6e73b48b5b18 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:37.857798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 854/1696] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:37.861885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691764-516e-4f30-91d5-6e73b48b5b18 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:37.881102 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691764-516e-4f30-91d5-6e73b48b5b18 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:37.983958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29e3ea-c107-4d82-ba1f-d3ac4970824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:37.983958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29e3ea-c107-4d82-ba1f-d3ac4970824a admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:37.983958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29e3ea-c107-4d82-ba1f-d3ac4970824a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:37.983958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29e3ea-c107-4d82-ba1f-d3ac4970824a admin admin] PATH_INFO: `/v3/projects/fc342ee621574ea69e8e6d5961351b10/users/c88253f7b79444f5ae6de800bad30604/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:37.985017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29e3ea-c107-4d82-ba1f-d3ac4970824a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc342ee621574ea69e8e6d5961351b10, user_id=c88253f7b79444f5ae6de800bad30604, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:37.985017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29e3ea-c107-4d82-ba1f-d3ac4970824a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:37.985017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 855/1697] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:37 2022] PUT /identity/v3/projects/fc342ee621574ea69e8e6d5961351b10/users/c88253f7b79444f5ae6de800bad30604/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:00:37.985017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3f5c-4df0-45bd-9756-1677fa20773b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:37.985493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3f5c-4df0-45bd-9756-1677fa20773b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:37.985493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e3f5c-4df0-45bd-9756-1677fa20773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:38.020137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc5af41104c482ca79d8d65c599f5b3', 'request_id': 'req-d2a25344-5f11-41fe-a468-2e32fd08a09a'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:38.022088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9a0e3f5c-4df0-45bd-9756-1677fa20773b None None] MFA Rules not processed for user `c88253f7b79444f5ae6de800bad30604`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:38.023751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9a0e3f5c-4df0-45bd-9756-1677fa20773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:38.063585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] The token cache is being invalidate because project 4fc5af41104c482ca79d8d65c599f5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:38.068534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:38.074107 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d2a25344-5f11-41fe-a468-2e32fd08a09a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:38.075888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 843/1698] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:37 2022] DELETE /identity/v3/projects/4fc5af41104c482ca79d8d65c599f5b3 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:38.080455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5a617-b920-4613-9611-4acbfd905fa3 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:38.080737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5a617-b920-4613-9611-4acbfd905fa3 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:38.081007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5a617-b920-4613-9611-4acbfd905fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:38.143197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c0f5a617-b920-4613-9611-4acbfd905fa3 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:38.147435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c0f5a617-b920-4613-9611-4acbfd905fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:38.194000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 856/1699] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:38.195140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e3f5c-4df0-45bd-9756-1677fa20773b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:38.196986 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9a0e3f5c-4df0-45bd-9756-1677fa20773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:38.301362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 844/1700] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:38.301362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5a617-b920-4613-9611-4acbfd905fa3 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:38.304889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c0f5a617-b920-4613-9611-4acbfd905fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:38.342751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e3f5c-4df0-45bd-9756-1677fa20773b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:38.358912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:38.359550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:38.359814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:38.360081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] PATH_INFO: `/v3/projects/c958b3da4602415c875456fc70b1e1d7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:38.365172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c958b3da4602415c875456fc70b1e1d7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:38.367156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:38.488533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5a617-b920-4613-9611-4acbfd905fa3 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:38.508781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95980a1-f45d-4341-978c-267bff10699b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:38.511733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95980a1-f45d-4341-978c-267bff10699b service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:38.511948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95980a1-f45d-4341-978c-267bff10699b service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:38.512271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95980a1-f45d-4341-978c-267bff10699b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:38.565837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95980a1-f45d-4341-978c-267bff10699b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:38.567510 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95980a1-f45d-4341-978c-267bff10699b service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:38.586443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c958b3da4602415c875456fc70b1e1d7', 'request_id': 'req-aed0351c-4266-4548-a4d2-af1ad1de293b'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:38.595752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c958b3da4602415c875456fc70b1e1d7', 'request_id': 'req-aed0351c-4266-4548-a4d2-af1ad1de293b'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:38.603885 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:38.614335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 845/1701] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:38.614335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222531b-c396-45f1-b24a-9211b445a531 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:38.614335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222531b-c396-45f1-b24a-9211b445a531 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:38.625755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222531b-c396-45f1-b24a-9211b445a531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:38.660810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7222531b-c396-45f1-b24a-9211b445a531 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:38.662570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7222531b-c396-45f1-b24a-9211b445a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:38.691556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c958b3da4602415c875456fc70b1e1d7', 'request_id': 'req-aed0351c-4266-4548-a4d2-af1ad1de293b'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:38.701331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:38.713953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] The token cache is being invalidate because project c958b3da4602415c875456fc70b1e1d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:38.714243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:38.715801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:38.724268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 857/1702] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:38 2022] DELETE /identity/v3/projects/c958b3da4602415c875456fc70b1e1d7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:38.724268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:38.730298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:38.937132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 846/1703] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:38.938313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222531b-c396-45f1-b24a-9211b445a531 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:38.941812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7222531b-c396-45f1-b24a-9211b445a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:38.951027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0351c-4266-4548-a4d2-af1ad1de293b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:38.966669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:38.967542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:38.967822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:38.968359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] PATH_INFO: `/v3/users/fa75bab0fdb441b4a7ab4ac07ca6ca30` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:38.973225 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa75bab0fdb441b4a7ab4ac07ca6ca30)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:38.983824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:39.015218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222531b-c396-45f1-b24a-9211b445a531 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:39.035958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:39.039363 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:39.044341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:39.045595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] PATH_INFO: `/v3/users/da7b08aeb6a04a5b82d0d49e4e75d741` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:39.049463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7b08aeb6a04a5b82d0d49e4e75d741)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:39.059637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:39.326611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa75bab0fdb441b4a7ab4ac07ca6ca30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:39.348435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7b08aeb6a04a5b82d0d49e4e75d741'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:39.360488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa75bab0fdb441b4a7ab4ac07ca6ca30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:39.361489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa75bab0fdb441b4a7ab4ac07ca6ca30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:39.362264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa75bab0fdb441b4a7ab4ac07ca6ca30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:39.369319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7b08aeb6a04a5b82d0d49e4e75d741'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:39.388551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7b08aeb6a04a5b82d0d49e4e75d741'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:39.389690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7b08aeb6a04a5b82d0d49e4e75d741'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:39.390407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-126d93c6-d947-4991-bc0a-d0fd0023bfea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7b08aeb6a04a5b82d0d49e4e75d741'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:39.454689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa75bab0fdb441b4a7ab4ac07ca6ca30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:39.476824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 858/1704] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:38 2022] DELETE /identity/v3/users/fa75bab0fdb441b4a7ab4ac07ca6ca30 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:39.496473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:39.498544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:39.523075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 847/1705] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:38 2022] DELETE /identity/v3/users/da7b08aeb6a04a5b82d0d49e4e75d741 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:39.523075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f830-3da8-4228-acc9-ab7ed873e326 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:39.523428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f830-3da8-4228-acc9-ab7ed873e326 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:39.523632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392f830-3da8-4228-acc9-ab7ed873e326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:39.632101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-3392f830-3da8-4228-acc9-ab7ed873e326 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:39.633909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3392f830-3da8-4228-acc9-ab7ed873e326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:39.752828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:39.795141 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b1873-4205-4105-a618-a17cc9d14017 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:39.946836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 848/1706] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:39.951810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7b16-60fc-4ea7-8a7e-6a9713fc66b8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:39.951810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7b16-60fc-4ea7-8a7e-6a9713fc66b8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:39.951810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7b16-60fc-4ea7-8a7e-6a9713fc66b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:40.066461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bdd92-6cfb-4d31-ae01-5ac723328420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:40.077437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bdd92-6cfb-4d31-ae01-5ac723328420 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:40.078007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bdd92-6cfb-4d31-ae01-5ac723328420 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:40.078457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bdd92-6cfb-4d31-ae01-5ac723328420 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:40.079357 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bdd92-6cfb-4d31-ae01-5ac723328420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:40.079855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bdd92-6cfb-4d31-ae01-5ac723328420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:40.082405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bdd92-6cfb-4d31-ae01-5ac723328420 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:40.119683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 859/1707] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 642 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:40.124176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bdd92-6cfb-4d31-ae01-5ac723328420 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:40.142131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:40.148492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f51bdd92-6cfb-4d31-ae01-5ac723328420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:40.150710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-5aaa7b16-60fc-4ea7-8a7e-6a9713fc66b8 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:40.151909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5aaa7b16-60fc-4ea7-8a7e-6a9713fc66b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:40.164897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bdd92-6cfb-4d31-ae01-5ac723328420 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:40.173074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1520-2b6f-437f-9c4e-9a9db0d8dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:40.174360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1520-2b6f-437f-9c4e-9a9db0d8dc4d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:40.204532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1520-2b6f-437f-9c4e-9a9db0d8dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:40.204918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1520-2b6f-437f-9c4e-9a9db0d8dc4d admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:40.205728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc1520-2b6f-437f-9c4e-9a9db0d8dc4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:40.207802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc1520-2b6f-437f-9c4e-9a9db0d8dc4d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:40.362976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 849/1708] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:00:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:40.364540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa7b16-60fc-4ea7-8a7e-6a9713fc66b8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:40.366511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5aaa7b16-60fc-4ea7-8a7e-6a9713fc66b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:40.371837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 860/1709] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:40 2022] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:00:40.371837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1520-2b6f-437f-9c4e-9a9db0d8dc4d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:40.383042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a3fc1520-2b6f-437f-9c4e-9a9db0d8dc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:40.524203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1520-2b6f-437f-9c4e-9a9db0d8dc4d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:40.560630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:40.562573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:40.563320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:40.565649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] PATH_INFO: `/v3/users/7bbde952395040d1bd6bc5673478d7cc` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:40.568537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bbde952395040d1bd6bc5673478d7cc)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:40.576897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:40.636660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa7b16-60fc-4ea7-8a7e-6a9713fc66b8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:40.842292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bbde952395040d1bd6bc5673478d7cc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:40.843299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aea71-e99d-43cb-b2db-6360114b69b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:40.851482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aea71-e99d-43cb-b2db-6360114b69b8 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:40.852047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aea71-e99d-43cb-b2db-6360114b69b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:40.852330 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aea71-e99d-43cb-b2db-6360114b69b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:40.880196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bbde952395040d1bd6bc5673478d7cc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:40.884149 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bbde952395040d1bd6bc5673478d7cc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:40.885781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aea71-e99d-43cb-b2db-6360114b69b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:40.891126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aea71-e99d-43cb-b2db-6360114b69b8 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:40.905225 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bbde952395040d1bd6bc5673478d7cc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:40.919288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 850/1710] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:40.920216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aea71-e99d-43cb-b2db-6360114b69b8 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:40.942759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aea71-e99d-43cb-b2db-6360114b69b8 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:40.954404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92a161-52ab-4008-a6e1-50e611434434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:40.954404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92a161-52ab-4008-a6e1-50e611434434 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:40.954404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92a161-52ab-4008-a6e1-50e611434434 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:40.954404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92a161-52ab-4008-a6e1-50e611434434 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:40.967543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92a161-52ab-4008-a6e1-50e611434434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:40.970267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92a161-52ab-4008-a6e1-50e611434434 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:41.049350 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-35d7dff3-1847-4544-8278-81db1547b25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bbde952395040d1bd6bc5673478d7cc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:41.096960 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 861/1711] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:40 2022] DELETE /identity/v3/users/7bbde952395040d1bd6bc5673478d7cc => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:41.098645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fe35e-4820-4643-81e9-9c0598736f83 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:41.098912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fe35e-4820-4643-81e9-9c0598736f83 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:41.101342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fe35e-4820-4643-81e9-9c0598736f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:41.120543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 851/1712] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:40 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:41.120543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92a161-52ab-4008-a6e1-50e611434434 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:41.122656 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ff92a161-52ab-4008-a6e1-50e611434434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:41.208907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-db4fe35e-4820-4643-81e9-9c0598736f83 None None] MFA Rules not processed for user `5f8353e92dc54d08ae0a82381d6d619d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:41.216486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-db4fe35e-4820-4643-81e9-9c0598736f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:41.324234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:41.375280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92a161-52ab-4008-a6e1-50e611434434 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:41.388604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 862/1713] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:41.397761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98f65e-0b43-4858-a193-064b69e93263 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:41.398295 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98f65e-0b43-4858-a193-064b69e93263 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:41.402757 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98f65e-0b43-4858-a193-064b69e93263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:41.438971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2a98f65e-0b43-4858-a193-064b69e93263 None None] MFA Rules not processed for user `03403068f7da491499f2a62ad218159e`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:41.440414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2a98f65e-0b43-4858-a193-064b69e93263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:41.530098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0062-ea9c-4f3e-9828-0783b7d7a91b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:41.530723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0062-ea9c-4f3e-9828-0783b7d7a91b service swift] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:41.531001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0062-ea9c-4f3e-9828-0783b7d7a91b service swift] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:41.531270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0062-ea9c-4f3e-9828-0783b7d7a91b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:41.533577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-042b0062-ea9c-4f3e-9828-0783b7d7a91b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:41.593042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 863/1714] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:41.595245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47f5b9-3171-4252-8a9e-dfaf0315e715 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:41.599103 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47f5b9-3171-4252-8a9e-dfaf0315e715 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:41.599103 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47f5b9-3171-4252-8a9e-dfaf0315e715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:41.621816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b0062-ea9c-4f3e-9828-0783b7d7a91b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:41.623072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5d47f5b9-3171-4252-8a9e-dfaf0315e715 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:41.624020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b0062-ea9c-4f3e-9828-0783b7d7a91b service swift] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:41.625359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5d47f5b9-3171-4252-8a9e-dfaf0315e715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:41.634489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 852/1715] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:00:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:41.635657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0062-ea9c-4f3e-9828-0783b7d7a91b service swift] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:41.638699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-042b0062-ea9c-4f3e-9828-0783b7d7a91b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:41.679996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:41.767711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0062-ea9c-4f3e-9828-0783b7d7a91b service swift] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:41.774108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb47bdb-43de-463e-bf15-4430f9ea8ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:41.775219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb47bdb-43de-463e-bf15-4430f9ea8ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:41.775702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb47bdb-43de-463e-bf15-4430f9ea8ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:41.776146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb47bdb-43de-463e-bf15-4430f9ea8ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:41.777570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb47bdb-43de-463e-bf15-4430f9ea8ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:41.787970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 864/1716] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:41.788909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47f5b9-3171-4252-8a9e-dfaf0315e715 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:41.790065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb47bdb-43de-463e-bf15-4430f9ea8ab2 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:41.790835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5d47f5b9-3171-4252-8a9e-dfaf0315e715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:41.808597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47f5b9-3171-4252-8a9e-dfaf0315e715 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:41.821042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:41.821042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:41.821042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:41.821042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] PATH_INFO: `/v3/projects/c3aee228cec64a9ebede190ecd43d509` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:41.821446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3aee228cec64a9ebede190ecd43d509)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:41.822329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 853/1717] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:41.823163 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:41.825091 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb47bdb-43de-463e-bf15-4430f9ea8ab2 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:41.829382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fdb47bdb-43de-463e-bf15-4430f9ea8ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:41.953429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb47bdb-43de-463e-bf15-4430f9ea8ab2 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:41.961500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19def2d1-10c9-4d8a-ba91-85adc93ff067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:41.962298 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def2d1-10c9-4d8a-ba91-85adc93ff067 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:41.962684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def2d1-10c9-4d8a-ba91-85adc93ff067 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:41.963101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def2d1-10c9-4d8a-ba91-85adc93ff067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:41.979874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19def2d1-10c9-4d8a-ba91-85adc93ff067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:41.982787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19def2d1-10c9-4d8a-ba91-85adc93ff067 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:42.018732 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3aee228cec64a9ebede190ecd43d509', 'request_id': 'req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:42.024194 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 854/1718] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:42.030831 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19def2d1-10c9-4d8a-ba91-85adc93ff067 service nova] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:42.036369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-19def2d1-10c9-4d8a-ba91-85adc93ff067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:42.056986 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3aee228cec64a9ebede190ecd43d509', 'request_id': 'req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:42.114293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19def2d1-10c9-4d8a-ba91-85adc93ff067 service nova] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:42.152392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3aee228cec64a9ebede190ecd43d509', 'request_id': 'req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:42.174735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] The token cache is being invalidate because project c3aee228cec64a9ebede190ecd43d509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:42.175033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:42.180238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:42.184960 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 865/1719] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:41 2022] DELETE /identity/v3/projects/c3aee228cec64a9ebede190ecd43d509 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:42.185859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:42.187966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:42.350775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9f28-60ee-41e0-85bf-8f4d12e2413b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:42.354216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9f28-60ee-41e0-85bf-8f4d12e2413b service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:42.354216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9f28-60ee-41e0-85bf-8f4d12e2413b service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:42.354216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9f28-60ee-41e0-85bf-8f4d12e2413b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:42.354216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9b0b9f28-60ee-41e0-85bf-8f4d12e2413b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:42.385721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cb1a0-a34b-431f-9d0d-ada9690d2cdd admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:42.390043 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676d08d-e158-4851-adfc-1abb884f0be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:42.390658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676d08d-e158-4851-adfc-1abb884f0be5 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:42.390932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676d08d-e158-4851-adfc-1abb884f0be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:42.391916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676d08d-e158-4851-adfc-1abb884f0be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:42.394703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4676d08d-e158-4851-adfc-1abb884f0be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:42.562602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b9f28-60ee-41e0-85bf-8f4d12e2413b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:42.567631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b9f28-60ee-41e0-85bf-8f4d12e2413b service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:42.594677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 855/1720] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:42.598057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9f28-60ee-41e0-85bf-8f4d12e2413b service nova] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:42.601195 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9b0b9f28-60ee-41e0-85bf-8f4d12e2413b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:42.606125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676d08d-e158-4851-adfc-1abb884f0be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:42.625861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676d08d-e158-4851-adfc-1abb884f0be5 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:42.655943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9f28-60ee-41e0-85bf-8f4d12e2413b service nova] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:42.657280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 866/1721] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:42.661337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:42.675425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50482f5e-f059-4477-a0dd-9d9f6ab0a2c8 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:42.676778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50482f5e-f059-4477-a0dd-9d9f6ab0a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:42.678799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50482f5e-f059-4477-a0dd-9d9f6ab0a2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:42.680757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e00bb8-b5a0-4bf4-bc29-4b24a6f2568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:42.686243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00bb8-b5a0-4bf4-bc29-4b24a6f2568e admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:42.688421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00bb8-b5a0-4bf4-bc29-4b24a6f2568e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:42.688917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e00bb8-b5a0-4bf4-bc29-4b24a6f2568e admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:42.690709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e00bb8-b5a0-4bf4-bc29-4b24a6f2568e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:42.695755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e00bb8-b5a0-4bf4-bc29-4b24a6f2568e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:42.725055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 856/1722] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:42.726271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e00bb8-b5a0-4bf4-bc29-4b24a6f2568e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:42.732921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e9e00bb8-b5a0-4bf4-bc29-4b24a6f2568e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:42.764444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e00bb8-b5a0-4bf4-bc29-4b24a6f2568e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:42.774837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:42.775889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:42.782226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:42.782226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] PATH_INFO: `/v3/projects/2020fe628c444958951305dedabc79d7` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:42.785233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2020fe628c444958951305dedabc79d7)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:42.793367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:42.800445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-50482f5e-f059-4477-a0dd-9d9f6ab0a2c8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:42.805229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-50482f5e-f059-4477-a0dd-9d9f6ab0a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:42.849998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:42.879483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 867/1723] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:42.885450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50482f5e-f059-4477-a0dd-9d9f6ab0a2c8 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:42.932698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50482f5e-f059-4477-a0dd-9d9f6ab0a2c8 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:42.957378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bace7-f27d-4dfa-aab1-8628a2eaa065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:42.958213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bace7-f27d-4dfa-aab1-8628a2eaa065 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:42.958734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bace7-f27d-4dfa-aab1-8628a2eaa065 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:42.959459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bace7-f27d-4dfa-aab1-8628a2eaa065 admin admin] PATH_INFO: `/v3/projects/2ef96bbee75941678c5cdaa6eb11a7b5/users/29773407759549d6a7133095dc8bb427/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:43.038576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bace7-f27d-4dfa-aab1-8628a2eaa065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef96bbee75941678c5cdaa6eb11a7b5, user_id=29773407759549d6a7133095dc8bb427, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:43.046024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bace7-f27d-4dfa-aab1-8628a2eaa065 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:43.047122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2020fe628c444958951305dedabc79d7', 'request_id': 'req-b8cda894-ba5d-4c3d-a0fb-d359055d048b'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:43.061272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2020fe628c444958951305dedabc79d7', 'request_id': 'req-b8cda894-ba5d-4c3d-a0fb-d359055d048b'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:43.131121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2020fe628c444958951305dedabc79d7', 'request_id': 'req-b8cda894-ba5d-4c3d-a0fb-d359055d048b'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:43.144398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 868/1724] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:42 2022] PUT /identity/v3/projects/2ef96bbee75941678c5cdaa6eb11a7b5/users/29773407759549d6a7133095dc8bb427/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:43.146158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68fef3-6f62-4583-a613-c338058c5ed5 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:43.146443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68fef3-6f62-4583-a613-c338058c5ed5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:43.153092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68fef3-6f62-4583-a613-c338058c5ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:43.161229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] The token cache is being invalidate because project 2020fe628c444958951305dedabc79d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:43.161618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:43.166283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b8cda894-ba5d-4c3d-a0fb-d359055d048b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:43.178493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 857/1725] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:42 2022] DELETE /identity/v3/projects/2020fe628c444958951305dedabc79d7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:43.183789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aee7f0-3abf-4dfa-9d63-b161dda840c2 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:43.184077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aee7f0-3abf-4dfa-9d63-b161dda840c2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:43.184354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aee7f0-3abf-4dfa-9d63-b161dda840c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:43.237879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ab68fef3-6f62-4583-a613-c338058c5ed5 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:43.246711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ab68fef3-6f62-4583-a613-c338058c5ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:43.297556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-a2aee7f0-3abf-4dfa-9d63-b161dda840c2 None None] MFA Rules not processed for user `29773407759549d6a7133095dc8bb427`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:43.298791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a2aee7f0-3abf-4dfa-9d63-b161dda840c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:43.459664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 869/1726] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:43.462302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2aa70-ee57-4a93-bdbc-ea65b63ec08d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:43.462603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2aa70-ee57-4a93-bdbc-ea65b63ec08d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:43.462894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2aa70-ee57-4a93-bdbc-ea65b63ec08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:43.497331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 858/1727] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:43.502501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aee7f0-3abf-4dfa-9d63-b161dda840c2 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:43.514237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-61a2aa70-ee57-4a93-bdbc-ea65b63ec08d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:43.532175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-61a2aa70-ee57-4a93-bdbc-ea65b63ec08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:43.549799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aee7f0-3abf-4dfa-9d63-b161dda840c2 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:43.549799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8acbc3-4e50-40d0-8b0c-78696cb6fa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:43.549799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acbc3-4e50-40d0-8b0c-78696cb6fa71 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:43.549799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acbc3-4e50-40d0-8b0c-78696cb6fa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:43.552607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acbc3-4e50-40d0-8b0c-78696cb6fa71 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:43.554700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8acbc3-4e50-40d0-8b0c-78696cb6fa71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:43.555407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8acbc3-4e50-40d0-8b0c-78696cb6fa71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:43.558387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8acbc3-4e50-40d0-8b0c-78696cb6fa71 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:43.574974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 870/1728] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:43.576827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2aa70-ee57-4a93-bdbc-ea65b63ec08d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:43.579407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-61a2aa70-ee57-4a93-bdbc-ea65b63ec08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:43.597953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 859/1729] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:43.599810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9699cc-6df7-4af1-b806-a466371cc07f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:43.600227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9699cc-6df7-4af1-b806-a466371cc07f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:43.600599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9699cc-6df7-4af1-b806-a466371cc07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:43.619232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2aa70-ee57-4a93-bdbc-ea65b63ec08d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:43.630731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe1dff-1a91-47e7-8681-61f8e6a08a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:43.631363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe1dff-1a91-47e7-8681-61f8e6a08a69 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:43.631645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe1dff-1a91-47e7-8681-61f8e6a08a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:43.631919 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe1dff-1a91-47e7-8681-61f8e6a08a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:43.632543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe1dff-1a91-47e7-8681-61f8e6a08a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:43.633917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-aa9699cc-6df7-4af1-b806-a466371cc07f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:43.635503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-aa9699cc-6df7-4af1-b806-a466371cc07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:43.637082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe1dff-1a91-47e7-8681-61f8e6a08a69 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:43.648319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 860/1730] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:43.649847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9699cc-6df7-4af1-b806-a466371cc07f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:43.668915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9699cc-6df7-4af1-b806-a466371cc07f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:43.681677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338eb75-5bfe-4306-8042-996eaf5f834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:43.682880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338eb75-5bfe-4306-8042-996eaf5f834a admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:43.683418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338eb75-5bfe-4306-8042-996eaf5f834a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:43.684858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338eb75-5bfe-4306-8042-996eaf5f834a admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:43.687310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338eb75-5bfe-4306-8042-996eaf5f834a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:43.690204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338eb75-5bfe-4306-8042-996eaf5f834a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:43.879548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:43.942672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 871/1731] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:43 2022] POST /identity/v3/projects => generated 379 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:43.945760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe1dff-1a91-47e7-8681-61f8e6a08a69 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:43.963600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 861/1732] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:43 2022] POST /identity/v3/projects => generated 377 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:43.969024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4970d-08b3-428c-8425-3b85496879cc None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:43.969369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4970d-08b3-428c-8425-3b85496879cc None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:43.969661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4970d-08b3-428c-8425-3b85496879cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:44.103939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-74e4970d-08b3-428c-8425-3b85496879cc None None] MFA Rules not processed for user `ff5c08bfc5e94b65bd4addde267e4598`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:44.109138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:44.109857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-74e4970d-08b3-428c-8425-3b85496879cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:44.162693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe1dff-1a91-47e7-8681-61f8e6a08a69 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:44.213624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 862/1733] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Aug 10 23:00:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:44.215177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4970d-08b3-428c-8425-3b85496879cc None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:44.375570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:44.376589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d135d-366b-40bb-a8b1-58255b70567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:44.377243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d135d-366b-40bb-a8b1-58255b70567d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:44.377535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d135d-366b-40bb-a8b1-58255b70567d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:44.377808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d135d-366b-40bb-a8b1-58255b70567d admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:44.381968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d135d-366b-40bb-a8b1-58255b70567d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:44.390715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d135d-366b-40bb-a8b1-58255b70567d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:44.390869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4970d-08b3-428c-8425-3b85496879cc None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:44.390958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d135d-366b-40bb-a8b1-58255b70567d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:44.391036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3798b-c853-4c5e-88bd-5c773a572020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:44.391036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3798b-c853-4c5e-88bd-5c773a572020 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:44.391473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3798b-c853-4c5e-88bd-5c773a572020 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:44.392068 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3798b-c853-4c5e-88bd-5c773a572020 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:44.393212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3798b-c853-4c5e-88bd-5c773a572020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:44.396808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3798b-c853-4c5e-88bd-5c773a572020 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:44.399567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 872/1734] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:44.400470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d135d-366b-40bb-a8b1-58255b70567d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:44.416263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d135d-366b-40bb-a8b1-58255b70567d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:44.424365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b79a-693d-4549-bbcb-60671ad4f3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:44.426015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b79a-693d-4549-bbcb-60671ad4f3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:44.427332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b79a-693d-4549-bbcb-60671ad4f3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:44.428858 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685b79a-693d-4549-bbcb-60671ad4f3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:44.430665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685b79a-693d-4549-bbcb-60671ad4f3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:44.437676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685b79a-693d-4549-bbcb-60671ad4f3b4 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:44.444847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:44.535429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 863/1735] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:44 2022] POST /identity/v3/users => generated 296 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:44.535429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3798b-c853-4c5e-88bd-5c773a572020 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:44.538883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-75c3798b-c853-4c5e-88bd-5c773a572020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:44.569467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3798b-c853-4c5e-88bd-5c773a572020 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:44.578621 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7804c-c406-4aef-ac95-764b256be1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:44.579338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7804c-c406-4aef-ac95-764b256be1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:44.579686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7804c-c406-4aef-ac95-764b256be1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:44.580028 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7804c-c406-4aef-ac95-764b256be1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:44.598213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 873/1736] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:44 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:44.599389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b79a-693d-4549-bbcb-60671ad4f3b4 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:44.613760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7804c-c406-4aef-ac95-764b256be1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:44.616324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7804c-c406-4aef-ac95-764b256be1a8 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:44.626449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685b79a-693d-4549-bbcb-60671ad4f3b4 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:44.640172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 864/1737] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:44.640875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7804c-c406-4aef-ac95-764b256be1a8 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:44.643378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e8a9f-6d61-476d-8c45-b84f7b6b25c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:44.644146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8a9f-6d61-476d-8c45-b84f7b6b25c2 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:44.644428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8a9f-6d61-476d-8c45-b84f7b6b25c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:44.645032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8a9f-6d61-476d-8c45-b84f7b6b25c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:44.646841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e8a9f-6d61-476d-8c45-b84f7b6b25c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:44.650169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e8a9f-6d61-476d-8c45-b84f7b6b25c2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:44.670832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7804c-c406-4aef-ac95-764b256be1a8 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:44.684076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417c5d5-9a4b-4372-875b-62511b161132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:44.688734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417c5d5-9a4b-4372-875b-62511b161132 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:44.688734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417c5d5-9a4b-4372-875b-62511b161132 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:44.689133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417c5d5-9a4b-4372-875b-62511b161132 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:44.689840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417c5d5-9a4b-4372-875b-62511b161132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:44.691501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417c5d5-9a4b-4372-875b-62511b161132 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:44.711943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 865/1738] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:44.712730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417c5d5-9a4b-4372-875b-62511b161132 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:44.737034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417c5d5-9a4b-4372-875b-62511b161132 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:44.763659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317642-4844-4f0b-8d52-2fe1b922c254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:44.765313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317642-4844-4f0b-8d52-2fe1b922c254 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:44.766213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317642-4844-4f0b-8d52-2fe1b922c254 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:44.766857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317642-4844-4f0b-8d52-2fe1b922c254 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:44.768335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7317642-4844-4f0b-8d52-2fe1b922c254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:44.772591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7317642-4844-4f0b-8d52-2fe1b922c254 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:44.787799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 874/1739] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:44 2022] POST /identity/v3/projects => generated 355 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:44.789032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e8a9f-6d61-476d-8c45-b84f7b6b25c2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:44.797488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:44.828184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 866/1740] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:44.833887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317642-4844-4f0b-8d52-2fe1b922c254 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:44.886899 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317642-4844-4f0b-8d52-2fe1b922c254 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:44.963513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e8a9f-6d61-476d-8c45-b84f7b6b25c2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:44.969781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f3d65-9797-4014-a476-59ff4a62d913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:44.970687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3d65-9797-4014-a476-59ff4a62d913 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:44.971121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3d65-9797-4014-a476-59ff4a62d913 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:44.971573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f3d65-9797-4014-a476-59ff4a62d913 admin admin] PATH_INFO: `/v3/projects/ee37416a40b04f338acca49c556aba2a/users/6a0d172a78c04344b128d2df5db182e9/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:44.991976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f3d65-9797-4014-a476-59ff4a62d913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee37416a40b04f338acca49c556aba2a, user_id=6a0d172a78c04344b128d2df5db182e9, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:44.995514 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f3d65-9797-4014-a476-59ff4a62d913 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:45.085617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd384967-de6e-47fb-9fbc-80e336529856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:45.088785 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384967-de6e-47fb-9fbc-80e336529856 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:45.089089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384967-de6e-47fb-9fbc-80e336529856 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:45.090561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384967-de6e-47fb-9fbc-80e336529856 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:45.091335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd384967-de6e-47fb-9fbc-80e336529856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:45.094963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd384967-de6e-47fb-9fbc-80e336529856 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:45.102522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 875/1741] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:44 2022] PUT /identity/v3/projects/ee37416a40b04f338acca49c556aba2a/users/6a0d172a78c04344b128d2df5db182e9/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:45.104121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f3d65-9797-4014-a476-59ff4a62d913 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:45.242519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f3d65-9797-4014-a476-59ff4a62d913 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:45.250862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc447585-47ae-459f-834b-43f50048bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:45.251839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc447585-47ae-459f-834b-43f50048bc42 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:45.252324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc447585-47ae-459f-834b-43f50048bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:45.253943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc447585-47ae-459f-834b-43f50048bc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:45.258731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc447585-47ae-459f-834b-43f50048bc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:45.259740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc447585-47ae-459f-834b-43f50048bc42 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:45.283440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 876/1742] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:45.284655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc447585-47ae-459f-834b-43f50048bc42 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:45.285987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 867/1743] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:44 2022] POST /identity/v3/users => generated 278 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:45.285987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd384967-de6e-47fb-9fbc-80e336529856 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:45.297844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc447585-47ae-459f-834b-43f50048bc42 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:45.303005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84311fc0-981e-4650-a1f6-2648e6fe7068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:45.303801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311fc0-981e-4650-a1f6-2648e6fe7068 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:45.304247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311fc0-981e-4650-a1f6-2648e6fe7068 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:45.304988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311fc0-981e-4650-a1f6-2648e6fe7068 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:45.305824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84311fc0-981e-4650-a1f6-2648e6fe7068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:45.307655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84311fc0-981e-4650-a1f6-2648e6fe7068 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:45.316793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd384967-de6e-47fb-9fbc-80e336529856 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:45.325337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 877/1744] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:45.328533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84311fc0-981e-4650-a1f6-2648e6fe7068 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:45.340641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3afea-1303-4570-8e32-bb71a9334307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:45.344011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3afea-1303-4570-8e32-bb71a9334307 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:45.346421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3afea-1303-4570-8e32-bb71a9334307 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:45.346717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3afea-1303-4570-8e32-bb71a9334307 admin admin] PATH_INFO: `/v3/projects/aad6ce3578c244bc8be39f0c8d24c391/users/72b6086749424468b25e52292eebf558/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:45.350623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84311fc0-981e-4650-a1f6-2648e6fe7068 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:45.355907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d461113-4bf4-4fcf-a7d8-6c65a211f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:45.356879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d461113-4bf4-4fcf-a7d8-6c65a211f790 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:45.357359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d461113-4bf4-4fcf-a7d8-6c65a211f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:45.358096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d461113-4bf4-4fcf-a7d8-6c65a211f790 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:45.358886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d461113-4bf4-4fcf-a7d8-6c65a211f790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:45.362251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d461113-4bf4-4fcf-a7d8-6c65a211f790 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:45.375508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 878/1745] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:45.378517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d461113-4bf4-4fcf-a7d8-6c65a211f790 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:45.394945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d461113-4bf4-4fcf-a7d8-6c65a211f790 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:45.410483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813815e-cbe0-4646-af71-576dacfba9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:45.412274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813815e-cbe0-4646-af71-576dacfba9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:45.412274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813815e-cbe0-4646-af71-576dacfba9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:45.412274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813815e-cbe0-4646-af71-576dacfba9ff admin admin] PATH_INFO: `/v3/projects/ee37416a40b04f338acca49c556aba2a/users/6a0d172a78c04344b128d2df5db182e9/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:45.416298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813815e-cbe0-4646-af71-576dacfba9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee37416a40b04f338acca49c556aba2a, user_id=6a0d172a78c04344b128d2df5db182e9, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:45.419568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813815e-cbe0-4646-af71-576dacfba9ff admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:45.424973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3afea-1303-4570-8e32-bb71a9334307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad6ce3578c244bc8be39f0c8d24c391, user_id=72b6086749424468b25e52292eebf558, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:45.427685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3afea-1303-4570-8e32-bb71a9334307 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:45.444502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 879/1746] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:45 2022] PUT /identity/v3/projects/ee37416a40b04f338acca49c556aba2a/users/6a0d172a78c04344b128d2df5db182e9/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:45.445615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813815e-cbe0-4646-af71-576dacfba9ff admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:45.559103 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813815e-cbe0-4646-af71-576dacfba9ff admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:45.569980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e76b8-8dc7-4359-8c79-376fcf8a5bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:45.570361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e76b8-8dc7-4359-8c79-376fcf8a5bff admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:45.570792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e76b8-8dc7-4359-8c79-376fcf8a5bff admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:45.571709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e76b8-8dc7-4359-8c79-376fcf8a5bff admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:45.572539 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e76b8-8dc7-4359-8c79-376fcf8a5bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:45.574716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e76b8-8dc7-4359-8c79-376fcf8a5bff admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:45.589586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 868/1747] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:45 2022] PUT /identity/v3/projects/aad6ce3578c244bc8be39f0c8d24c391/users/72b6086749424468b25e52292eebf558/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:45.593123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba006c41-4fa0-4045-b14f-42583dd80726 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:45.593123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba006c41-4fa0-4045-b14f-42583dd80726 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:45.594479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba006c41-4fa0-4045-b14f-42583dd80726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:45.612211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 880/1748] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:45.633518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f9deb-cf53-4aeb-aa1a-7cb40aace414 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:45.636054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f9deb-cf53-4aeb-aa1a-7cb40aace414 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:45.636286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f9deb-cf53-4aeb-aa1a-7cb40aace414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:45.715558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ba006c41-4fa0-4045-b14f-42583dd80726 None None] MFA Rules not processed for user `6a0d172a78c04344b128d2df5db182e9`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:45.718113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ba006c41-4fa0-4045-b14f-42583dd80726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:45.729493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:45.771302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-899f9deb-cf53-4aeb-aa1a-7cb40aace414 None None] MFA Rules not processed for user `72b6086749424468b25e52292eebf558`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:45.772728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-899f9deb-cf53-4aeb-aa1a-7cb40aace414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:45.925593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 869/1749] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:45.926562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba006c41-4fa0-4045-b14f-42583dd80726 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:45.946690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 881/1750] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:45.963884 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f9deb-cf53-4aeb-aa1a-7cb40aace414 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:45.971549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-899f9deb-cf53-4aeb-aa1a-7cb40aace414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:46.009160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:46.160576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba006c41-4fa0-4045-b14f-42583dd80726 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:46.173981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b0b52-f503-4351-a258-8f7e8db0d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:46.174723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b0b52-f503-4351-a258-8f7e8db0d02d admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:46.175615 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b0b52-f503-4351-a258-8f7e8db0d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:46.175888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b0b52-f503-4351-a258-8f7e8db0d02d admin admin] PATH_INFO: `/v3/projects/4443d226e3ed4b69a1ecb666a1965424/users/bcd6bb97e185474d98d551947f07d0be/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:46.208970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b0b52-f503-4351-a258-8f7e8db0d02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4443d226e3ed4b69a1ecb666a1965424, user_id=bcd6bb97e185474d98d551947f07d0be, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:46.211886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b0b52-f503-4351-a258-8f7e8db0d02d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:46.255773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f9deb-cf53-4aeb-aa1a-7cb40aace414 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:46.279773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:46.283883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:46.284914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:46.288487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] PATH_INFO: `/v3/projects/e6a2572348544df19978ba422d7eed42` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:46.312781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a2572348544df19978ba422d7eed42)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:46.324169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:46.336577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 870/1751] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:45 2022] PUT /identity/v3/projects/4443d226e3ed4b69a1ecb666a1965424/users/bcd6bb97e185474d98d551947f07d0be/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:46.337774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b0b52-f503-4351-a258-8f7e8db0d02d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:46.352352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-393b0b52-f503-4351-a258-8f7e8db0d02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:46.467623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b0b52-f503-4351-a258-8f7e8db0d02d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:46.486629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c06e5-a728-432a-8049-21c21def3051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:46.488897 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c06e5-a728-432a-8049-21c21def3051 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:46.489434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c06e5-a728-432a-8049-21c21def3051 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:46.490803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c06e5-a728-432a-8049-21c21def3051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:46.525556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a2572348544df19978ba422d7eed42', 'request_id': 'req-1cba3cd5-9838-4450-bd83-8ea270cc86e5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:46.542924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a2572348544df19978ba422d7eed42', 'request_id': 'req-1cba3cd5-9838-4450-bd83-8ea270cc86e5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:46.595583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:46.665877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a2572348544df19978ba422d7eed42', 'request_id': 'req-1cba3cd5-9838-4450-bd83-8ea270cc86e5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:46.693418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] The token cache is being invalidate because project e6a2572348544df19978ba422d7eed42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:46.697476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:46.698306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:46.701454 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 882/1752] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:45 2022] DELETE /identity/v3/projects/e6a2572348544df19978ba422d7eed42 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:46.702834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:46.705892 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:46.783956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c06e5-a728-432a-8049-21c21def3051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:46.790982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c06e5-a728-432a-8049-21c21def3051 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:46.827351 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 871/1753] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:46.828656 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693e2dd-7b66-4e79-ab97-41bb53ad8783 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:46.828934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693e2dd-7b66-4e79-ab97-41bb53ad8783 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:46.829190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693e2dd-7b66-4e79-ab97-41bb53ad8783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:46.846871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:46.932771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-5693e2dd-7b66-4e79-ab97-41bb53ad8783 None None] MFA Rules not processed for user `bcd6bb97e185474d98d551947f07d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:46.932771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5693e2dd-7b66-4e79-ab97-41bb53ad8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:46.960594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3cd5-9838-4450-bd83-8ea270cc86e5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:46.975602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd008-8630-4a2f-be8a-22638aafc9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:46.976862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd008-8630-4a2f-be8a-22638aafc9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:46.977148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd008-8630-4a2f-be8a-22638aafc9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:46.978675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd008-8630-4a2f-be8a-22638aafc9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:46.983976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bd008-8630-4a2f-be8a-22638aafc9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:46.987312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bd008-8630-4a2f-be8a-22638aafc9e8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:47.120311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 872/1754] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:47.121171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693e2dd-7b66-4e79-ab97-41bb53ad8783 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:47.122525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5693e2dd-7b66-4e79-ab97-41bb53ad8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:47.158271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693e2dd-7b66-4e79-ab97-41bb53ad8783 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:47.184714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 883/1755] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:46 2022] POST /identity/v3/projects => generated 381 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:47.190060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd008-8630-4a2f-be8a-22638aafc9e8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:47.193518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:47.194341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:47.194616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:47.194883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] PATH_INFO: `/v3/users/c88253f7b79444f5ae6de800bad30604` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:47.196521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88253f7b79444f5ae6de800bad30604)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:47.198474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:47.226013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ab1bd008-8630-4a2f-be8a-22638aafc9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:47.375112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:47.380848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd008-8630-4a2f-be8a-22638aafc9e8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:47.398179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c9966-1b37-4b46-a8cc-565a815e9ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:47.398834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c9966-1b37-4b46-a8cc-565a815e9ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:47.399136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c9966-1b37-4b46-a8cc-565a815e9ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:47.399383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c9966-1b37-4b46-a8cc-565a815e9ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:47.400013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c9966-1b37-4b46-a8cc-565a815e9ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:47.402022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c9966-1b37-4b46-a8cc-565a815e9ad9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:47.457174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88253f7b79444f5ae6de800bad30604'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:47.498088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88253f7b79444f5ae6de800bad30604'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:47.526136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 884/1756] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:47 2022] POST /identity/v3/projects => generated 355 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:47.527263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c9966-1b37-4b46-a8cc-565a815e9ad9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:47.564844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88253f7b79444f5ae6de800bad30604'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:47.565837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88253f7b79444f5ae6de800bad30604'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:47.566462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88253f7b79444f5ae6de800bad30604'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:47.665521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 873/1757] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:47 2022] DELETE /identity/v3/users/c88253f7b79444f5ae6de800bad30604 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:47.666740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:47.668145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:47.740730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:47.747409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c9966-1b37-4b46-a8cc-565a815e9ad9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:47.861767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c9174-3275-428d-9225-62c9d3b6a9bc admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:47.869052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9755c7-c8fb-4adf-a00a-8b02f743ff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:47.869733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9755c7-c8fb-4adf-a00a-8b02f743ff6a admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:47.871684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9755c7-c8fb-4adf-a00a-8b02f743ff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:47.871684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9755c7-c8fb-4adf-a00a-8b02f743ff6a admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:47.871684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9755c7-c8fb-4adf-a00a-8b02f743ff6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:47.874225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9755c7-c8fb-4adf-a00a-8b02f743ff6a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:47.952221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acb1b-6b02-4f21-afad-feaa672ff2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:47.954385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acb1b-6b02-4f21-afad-feaa672ff2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:47.954385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acb1b-6b02-4f21-afad-feaa672ff2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:47.954385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210acb1b-6b02-4f21-afad-feaa672ff2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:47.955680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210acb1b-6b02-4f21-afad-feaa672ff2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:47.959773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210acb1b-6b02-4f21-afad-feaa672ff2f6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:48.009915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 874/1758] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:47 2022] POST /identity/v3/users => generated 284 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:48.011349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a2e62-e712-45ab-9469-9a9414c793c0 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:48.011639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a2e62-e712-45ab-9469-9a9414c793c0 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:48.011909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a2e62-e712-45ab-9469-9a9414c793c0 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:48.013509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 875/1759] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:00:48.019067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a2e62-e712-45ab-9469-9a9414c793c0 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:48.064442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a2e62-e712-45ab-9469-9a9414c793c0 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:48.082145 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 885/1760] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:47 2022] POST /identity/v3/users => generated 297 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:48.083209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acb1b-6b02-4f21-afad-feaa672ff2f6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:48.088830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-210acb1b-6b02-4f21-afad-feaa672ff2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:48.098191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa10cf-b890-4656-b7bb-b1c867cab7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:48.101355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa10cf-b890-4656-b7bb-b1c867cab7ba admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:48.101355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa10cf-b890-4656-b7bb-b1c867cab7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:48.101355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa10cf-b890-4656-b7bb-b1c867cab7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:48.101355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa10cf-b890-4656-b7bb-b1c867cab7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:48.108972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa10cf-b890-4656-b7bb-b1c867cab7ba admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:48.111988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210acb1b-6b02-4f21-afad-feaa672ff2f6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:48.120223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74883175-2b59-4a04-912a-f0eb921157ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:48.124942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74883175-2b59-4a04-912a-f0eb921157ad admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:48.124942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74883175-2b59-4a04-912a-f0eb921157ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:48.124942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74883175-2b59-4a04-912a-f0eb921157ad admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:48.124942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74883175-2b59-4a04-912a-f0eb921157ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:48.130744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74883175-2b59-4a04-912a-f0eb921157ad admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:48.172141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 876/1761] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:48.179344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2afd-12dd-48b7-bd5f-712d4c8d152f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:48.179344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2afd-12dd-48b7-bd5f-712d4c8d152f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:48.179344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff2afd-12dd-48b7-bd5f-712d4c8d152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:48.184470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 886/1762] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:48.184470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74883175-2b59-4a04-912a-f0eb921157ad admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:48.214228 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74883175-2b59-4a04-912a-f0eb921157ad admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:48.227537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512c30-a477-41d8-9b5b-66ab75cb125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:48.228344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512c30-a477-41d8-9b5b-66ab75cb125c admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:48.228778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512c30-a477-41d8-9b5b-66ab75cb125c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:48.229148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512c30-a477-41d8-9b5b-66ab75cb125c admin admin] PATH_INFO: `/v3/projects/3ba3cba55ddf45ce816055dd8e157d91/users/6c87a86613264c829205e84a7ea1ac75/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:48.250559 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-adff2afd-12dd-48b7-bd5f-712d4c8d152f None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:48.251243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-adff2afd-12dd-48b7-bd5f-712d4c8d152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:48.267202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a512c30-a477-41d8-9b5b-66ab75cb125c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba3cba55ddf45ce816055dd8e157d91, user_id=6c87a86613264c829205e84a7ea1ac75, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:48.271058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a512c30-a477-41d8-9b5b-66ab75cb125c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:48.346833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 887/1763] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:48 2022] PUT /identity/v3/projects/3ba3cba55ddf45ce816055dd8e157d91/users/6c87a86613264c829205e84a7ea1ac75/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:48.347767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512c30-a477-41d8-9b5b-66ab75cb125c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:48.478241 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 877/1764] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:00:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:48.479304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff2afd-12dd-48b7-bd5f-712d4c8d152f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:48.482040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-adff2afd-12dd-48b7-bd5f-712d4c8d152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:48.517435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512c30-a477-41d8-9b5b-66ab75cb125c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:48.541143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455c87-c67a-46a5-bb27-3d4a2a2f3711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:48.541937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455c87-c67a-46a5-bb27-3d4a2a2f3711 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:48.542278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455c87-c67a-46a5-bb27-3d4a2a2f3711 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:48.542633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455c87-c67a-46a5-bb27-3d4a2a2f3711 admin admin] PATH_INFO: `/v3/projects/1924679427644c8484613f703518badc/users/d01ea265e9174e9b8628e77fe07bc1e7/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:48.603235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba455c87-c67a-46a5-bb27-3d4a2a2f3711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1924679427644c8484613f703518badc, user_id=d01ea265e9174e9b8628e77fe07bc1e7, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:48.606294 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba455c87-c67a-46a5-bb27-3d4a2a2f3711 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:48.669873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff2afd-12dd-48b7-bd5f-712d4c8d152f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:48.699920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 888/1765] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:48 2022] PUT /identity/v3/projects/1924679427644c8484613f703518badc/users/d01ea265e9174e9b8628e77fe07bc1e7/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:48.702008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455c87-c67a-46a5-bb27-3d4a2a2f3711 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:48.783558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:48.843444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:48.909638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab10166-c32c-4696-940e-bd249eabb557 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0d172a78c04344b128d2df5db182e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee37416a40b04f338acca49c556aba2a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:48.910566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab10166-c32c-4696-940e-bd249eabb557 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:48.916650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab10166-c32c-4696-940e-bd249eabb557 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:48.916650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab10166-c32c-4696-940e-bd249eabb557 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:48.916650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab10166-c32c-4696-940e-bd249eabb557 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:48.916650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab10166-c32c-4696-940e-bd249eabb557 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:48.924606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab10166-c32c-4696-940e-bd249eabb557 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:48.989810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455c87-c67a-46a5-bb27-3d4a2a2f3711 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:48.995892 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 878/1766] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:48.997017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab10166-c32c-4696-940e-bd249eabb557 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:48.998183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd9b05-1cf0-4c43-9735-37017c279f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:48.998812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd9b05-1cf0-4c43-9735-37017c279f2e admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:48.999128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd9b05-1cf0-4c43-9735-37017c279f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:48.999357 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd9b05-1cf0-4c43-9735-37017c279f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:49.000028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd9b05-1cf0-4c43-9735-37017c279f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:49.001654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd9b05-1cf0-4c43-9735-37017c279f2e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:49.023263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab10166-c32c-4696-940e-bd249eabb557 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:49.028978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29573c97-848c-4522-b644-6d4b7715de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:49.029739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29573c97-848c-4522-b644-6d4b7715de4a admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:49.030016 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29573c97-848c-4522-b644-6d4b7715de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:49.030285 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29573c97-848c-4522-b644-6d4b7715de4a admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:49.030928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29573c97-848c-4522-b644-6d4b7715de4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:49.032698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29573c97-848c-4522-b644-6d4b7715de4a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:49.047079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 879/1767] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:49.048562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29573c97-848c-4522-b644-6d4b7715de4a admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:49.051127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-29573c97-848c-4522-b644-6d4b7715de4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:49.076592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 889/1768] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:49.098023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd9b05-1cf0-4c43-9735-37017c279f2e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:49.206789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd9b05-1cf0-4c43-9735-37017c279f2e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:49.212509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c026ad4-f80a-4297-af5e-5e1b84aceb07 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0d172a78c04344b128d2df5db182e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee37416a40b04f338acca49c556aba2a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:49.213428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c026ad4-f80a-4297-af5e-5e1b84aceb07 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:49.213962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c026ad4-f80a-4297-af5e-5e1b84aceb07 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:49.214249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c026ad4-f80a-4297-af5e-5e1b84aceb07 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:49.214891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c026ad4-f80a-4297-af5e-5e1b84aceb07 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:49.218124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c026ad4-f80a-4297-af5e-5e1b84aceb07 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:49.243516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:49.260074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29573c97-848c-4522-b644-6d4b7715de4a admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:49.277898 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2368b-7eef-4dac-af00-9e0d7a11f8e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:49.278807 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2368b-7eef-4dac-af00-9e0d7a11f8e7 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:49.279193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2368b-7eef-4dac-af00-9e0d7a11f8e7 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:49.279548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2368b-7eef-4dac-af00-9e0d7a11f8e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:49.293849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 890/1769] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:49 2022] POST /identity/v3/projects => generated 354 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:49.296046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c026ad4-f80a-4297-af5e-5e1b84aceb07 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:49.304575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2368b-7eef-4dac-af00-9e0d7a11f8e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:49.307993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2368b-7eef-4dac-af00-9e0d7a11f8e7 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:49.335517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 880/1770] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:49.338299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2368b-7eef-4dac-af00-9e0d7a11f8e7 service nova] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:49.364100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2368b-7eef-4dac-af00-9e0d7a11f8e7 service nova] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:49.486019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c026ad4-f80a-4297-af5e-5e1b84aceb07 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:49.497851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ae108-ab5c-4815-981f-05365ea97052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:49.500036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ae108-ab5c-4815-981f-05365ea97052 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:49.500306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ae108-ab5c-4815-981f-05365ea97052 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:49.500594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ae108-ab5c-4815-981f-05365ea97052 admin admin] PATH_INFO: `/v3/projects/1924679427644c8484613f703518badc/users/d01ea265e9174e9b8628e77fe07bc1e7/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:49.507783 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ae108-ab5c-4815-981f-05365ea97052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1924679427644c8484613f703518badc, user_id=d01ea265e9174e9b8628e77fe07bc1e7, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:49.514435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ae108-ab5c-4815-981f-05365ea97052 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:49.535103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaed000-aaef-4c65-8ae7-f988d5a3bc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:49.538196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaed000-aaef-4c65-8ae7-f988d5a3bc5a admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:49.538463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaed000-aaef-4c65-8ae7-f988d5a3bc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:49.538737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaed000-aaef-4c65-8ae7-f988d5a3bc5a admin admin] PATH_INFO: `/v3/projects/3ba3cba55ddf45ce816055dd8e157d91/users/6c87a86613264c829205e84a7ea1ac75/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:49.550443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaed000-aaef-4c65-8ae7-f988d5a3bc5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba3cba55ddf45ce816055dd8e157d91, user_id=6c87a86613264c829205e84a7ea1ac75, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:49.561752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 891/1771] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:49 2022] PUT /identity/v3/projects/1924679427644c8484613f703518badc/users/d01ea265e9174e9b8628e77fe07bc1e7/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:49.562751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ae108-ab5c-4815-981f-05365ea97052 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:49.573788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaed000-aaef-4c65-8ae7-f988d5a3bc5a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:49.596949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 881/1772] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:49 2022] PUT /identity/v3/projects/3ba3cba55ddf45ce816055dd8e157d91/users/6c87a86613264c829205e84a7ea1ac75/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:49.599449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca6011-94d2-4976-b52c-727a12cfbf24 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:49.599755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca6011-94d2-4976-b52c-727a12cfbf24 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:49.600028 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca6011-94d2-4976-b52c-727a12cfbf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:49.699154 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-d0ca6011-94d2-4976-b52c-727a12cfbf24 None None] MFA Rules not processed for user `d01ea265e9174e9b8628e77fe07bc1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:49.707814 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d0ca6011-94d2-4976-b52c-727a12cfbf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:49.775710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:49.777648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ae108-ab5c-4815-981f-05365ea97052 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:49.825599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:49.937613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 882/1773] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:49.956706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92297743-2cc5-45df-a032-11e83c6c4685 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:49.961854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92297743-2cc5-45df-a032-11e83c6c4685 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:49.962536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92297743-2cc5-45df-a032-11e83c6c4685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:50.010709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2b986-6474-4d60-b579-ecf5d552e9e3 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0d172a78c04344b128d2df5db182e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee37416a40b04f338acca49c556aba2a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:50.011342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2b986-6474-4d60-b579-ecf5d552e9e3 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:50.011623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2b986-6474-4d60-b579-ecf5d552e9e3 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:50.011899 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2b986-6474-4d60-b579-ecf5d552e9e3 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:50.012560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2b986-6474-4d60-b579-ecf5d552e9e3 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:50.012864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2b986-6474-4d60-b579-ecf5d552e9e3 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:50.015237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2b986-6474-4d60-b579-ecf5d552e9e3 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:50.059064 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 892/1774] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:50.059934 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2b986-6474-4d60-b579-ecf5d552e9e3 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:50.062328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6bb2b986-6474-4d60-b579-ecf5d552e9e3 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:50.101085 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-92297743-2cc5-45df-a032-11e83c6c4685 None None] MFA Rules not processed for user `6c87a86613264c829205e84a7ea1ac75`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:50.103591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-92297743-2cc5-45df-a032-11e83c6c4685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:50.221039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2b986-6474-4d60-b579-ecf5d552e9e3 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:50.227198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3225f-2ce0-4ac0-b89d-8f2d972ea8fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:50.228278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3225f-2ce0-4ac0-b89d-8f2d972ea8fc service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:50.228707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3225f-2ce0-4ac0-b89d-8f2d972ea8fc service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:50.229125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3225f-2ce0-4ac0-b89d-8f2d972ea8fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:50.243023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3225f-2ce0-4ac0-b89d-8f2d972ea8fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:50.245011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3225f-2ce0-4ac0-b89d-8f2d972ea8fc service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:50.271883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 893/1775] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:50.273259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3225f-2ce0-4ac0-b89d-8f2d972ea8fc service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:50.297089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3225f-2ce0-4ac0-b89d-8f2d972ea8fc service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:50.303745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a0d172a78c04344b128d2df5db182e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee37416a40b04f338acca49c556aba2a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:50.305334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:50.305912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:50.306412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] PATH_INFO: `/v3/projects/91761abe26304bd8bd5ae1f569281018` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:50.308616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91761abe26304bd8bd5ae1f569281018)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:50.311519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:50.337569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 883/1776] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:50.347235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92297743-2cc5-45df-a032-11e83c6c4685 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:50.349824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-92297743-2cc5-45df-a032-11e83c6c4685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:50.403528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92297743-2cc5-45df-a032-11e83c6c4685 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:50.407683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e65d2-7c2b-47a8-8c83-f88abbae21ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:50.408553 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e65d2-7c2b-47a8-8c83-f88abbae21ca service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:50.408887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e65d2-7c2b-47a8-8c83-f88abbae21ca service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:50.410628 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e65d2-7c2b-47a8-8c83-f88abbae21ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:50.442777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e65d2-7c2b-47a8-8c83-f88abbae21ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:50.444819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e65d2-7c2b-47a8-8c83-f88abbae21ca service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:50.467358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91761abe26304bd8bd5ae1f569281018', 'request_id': 'req-30841e7f-8bdc-40f5-9a38-b1df71156588'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:50.478167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91761abe26304bd8bd5ae1f569281018', 'request_id': 'req-30841e7f-8bdc-40f5-9a38-b1df71156588'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:50.517538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 884/1777] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:50.535345 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91761abe26304bd8bd5ae1f569281018', 'request_id': 'req-30841e7f-8bdc-40f5-9a38-b1df71156588'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:50.580943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e65d2-7c2b-47a8-8c83-f88abbae21ca service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:50.583658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] The token cache is being invalidate because project 91761abe26304bd8bd5ae1f569281018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:50.584160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:50.601992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e65d2-7c2b-47a8-8c83-f88abbae21ca service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:50.604792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:50.632394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 894/1778] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:50 2022] DELETE /identity/v3/projects/91761abe26304bd8bd5ae1f569281018 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:50.754147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e184a-3111-422d-9869-32a3b21654d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:50.756846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e184a-3111-422d-9869-32a3b21654d0 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:50.757143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e184a-3111-422d-9869-32a3b21654d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:50.757470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e184a-3111-422d-9869-32a3b21654d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:50.760589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c44e184a-3111-422d-9869-32a3b21654d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:50.786390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:50.790763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:50.858372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:50.879346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:50.923978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e184a-3111-422d-9869-32a3b21654d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:50.926288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e184a-3111-422d-9869-32a3b21654d0 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:50.964054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 885/1779] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:00:50.964828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30841e7f-8bdc-40f5-9a38-b1df71156588 tempest-VolumeQuotaClassesTest-219834061 tempest-VolumeQuotaClassesTest-219834061-project-admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:50.972172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:50.972172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:50.972172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:50.972172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] PATH_INFO: `/v3/projects/fc342ee621574ea69e8e6d5961351b10` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:51.023542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc342ee621574ea69e8e6d5961351b10)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:51.033449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:51.282170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc342ee621574ea69e8e6d5961351b10', 'request_id': 'req-cf4b781e-4d05-4560-92aa-64cf12225246'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:51.306677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc342ee621574ea69e8e6d5961351b10', 'request_id': 'req-cf4b781e-4d05-4560-92aa-64cf12225246'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:51.392016 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc342ee621574ea69e8e6d5961351b10', 'request_id': 'req-cf4b781e-4d05-4560-92aa-64cf12225246'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:51.423031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] The token cache is being invalidate because project fc342ee621574ea69e8e6d5961351b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:51.426261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:51.429259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:51.429259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 895/1780] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:50 2022] DELETE /identity/v3/projects/fc342ee621574ea69e8e6d5961351b10 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:51.438702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec766bc9-b679-48df-b9f6-6bcb485bb8c3 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:51.438999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec766bc9-b679-48df-b9f6-6bcb485bb8c3 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:51.439283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec766bc9-b679-48df-b9f6-6bcb485bb8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:51.473647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ec766bc9-b679-48df-b9f6-6bcb485bb8c3 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:51.474858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ec766bc9-b679-48df-b9f6-6bcb485bb8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:51.589400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:51.593087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:51.630509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 886/1781] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:51.639616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec766bc9-b679-48df-b9f6-6bcb485bb8c3 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:51.639616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ec766bc9-b679-48df-b9f6-6bcb485bb8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:51.676172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec766bc9-b679-48df-b9f6-6bcb485bb8c3 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:51.704364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:51.705984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:51.714947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:51.715462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] PATH_INFO: `/v3/users/29773407759549d6a7133095dc8bb427` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:51.720359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=29773407759549d6a7133095dc8bb427)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:51.724944 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:51.792756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b781e-4d05-4560-92aa-64cf12225246 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:51.815064 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d041798-2d2c-482f-b2df-13f3221c336a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:51.816307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041798-2d2c-482f-b2df-13f3221c336a service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:51.816611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041798-2d2c-482f-b2df-13f3221c336a service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:51.816923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041798-2d2c-482f-b2df-13f3221c336a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:51.819781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1d041798-2d2c-482f-b2df-13f3221c336a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:51.970945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d041798-2d2c-482f-b2df-13f3221c336a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:51.981453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d041798-2d2c-482f-b2df-13f3221c336a service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:51.996110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 896/1782] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:00:51.999269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e208a-3672-410a-a417-f64e4165d0e2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:51.999557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e208a-3672-410a-a417-f64e4165d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:51.999828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e208a-3672-410a-a417-f64e4165d0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.041252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f55e208a-3672-410a-a417-f64e4165d0e2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:52.042850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f55e208a-3672-410a-a417-f64e4165d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:52.053964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29773407759549d6a7133095dc8bb427'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:52.058000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 897/1783] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:52.059537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e208a-3672-410a-a417-f64e4165d0e2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:52.074625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e208a-3672-410a-a417-f64e4165d0e2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:52.083553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02da8a2-b2fe-481f-9e15-4ee6ec07abed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:52.084347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02da8a2-b2fe-481f-9e15-4ee6ec07abed admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:52.084660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02da8a2-b2fe-481f-9e15-4ee6ec07abed admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:52.084891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29773407759549d6a7133095dc8bb427'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:52.084994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02da8a2-b2fe-481f-9e15-4ee6ec07abed admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.085679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02da8a2-b2fe-481f-9e15-4ee6ec07abed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:52.093473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02da8a2-b2fe-481f-9e15-4ee6ec07abed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:52.095614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02da8a2-b2fe-481f-9e15-4ee6ec07abed admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:52.113092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29773407759549d6a7133095dc8bb427'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:52.114741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29773407759549d6a7133095dc8bb427'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:52.115605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6d0bb678-40c6-47ad-b756-4e1c36cc1e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29773407759549d6a7133095dc8bb427'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:52.120112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 898/1784] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:52.122409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02da8a2-b2fe-481f-9e15-4ee6ec07abed admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:52.125987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a02da8a2-b2fe-481f-9e15-4ee6ec07abed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:52.172977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02da8a2-b2fe-481f-9e15-4ee6ec07abed admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:52.190456 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff97756-4503-4b0e-a0ae-bf8d0c4b5d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:52.194501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff97756-4503-4b0e-a0ae-bf8d0c4b5d2c admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:52.194501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff97756-4503-4b0e-a0ae-bf8d0c4b5d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:52.194501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff97756-4503-4b0e-a0ae-bf8d0c4b5d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.194501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff97756-4503-4b0e-a0ae-bf8d0c4b5d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:52.194861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 887/1785] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:51 2022] DELETE /identity/v3/users/29773407759549d6a7133095dc8bb427 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:52.194942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff97756-4503-4b0e-a0ae-bf8d0c4b5d2c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:52.198700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596acd8-bde3-4ba7-a0ac-b59004c16139 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:52.199208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596acd8-bde3-4ba7-a0ac-b59004c16139 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:52.199677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596acd8-bde3-4ba7-a0ac-b59004c16139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.237998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b596acd8-bde3-4ba7-a0ac-b59004c16139 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:52.239485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b596acd8-bde3-4ba7-a0ac-b59004c16139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:52.335516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:52.350670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 888/1786] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:52.359553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 899/1787] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:52 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:52.362780 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596acd8-bde3-4ba7-a0ac-b59004c16139 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:52.364328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff97756-4503-4b0e-a0ae-bf8d0c4b5d2c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:52.365004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b596acd8-bde3-4ba7-a0ac-b59004c16139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:52.505456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596acd8-bde3-4ba7-a0ac-b59004c16139 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:52.517339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:52.529785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff97756-4503-4b0e-a0ae-bf8d0c4b5d2c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:52.556925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9fb50-068e-4e27-b0e0-8468c45681bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:52.557658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9fb50-068e-4e27-b0e0-8468c45681bd admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:52.557944 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9fb50-068e-4e27-b0e0-8468c45681bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:52.558209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9fb50-068e-4e27-b0e0-8468c45681bd admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.559557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9fb50-068e-4e27-b0e0-8468c45681bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:52.563232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9fb50-068e-4e27-b0e0-8468c45681bd admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:52.637943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a04891-740c-4b05-bffd-d515df9e4a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:52.638874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a04891-740c-4b05-bffd-d515df9e4a49 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:52.641232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a04891-740c-4b05-bffd-d515df9e4a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:52.641678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a04891-740c-4b05-bffd-d515df9e4a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.675223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a04891-740c-4b05-bffd-d515df9e4a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:52.677655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a04891-740c-4b05-bffd-d515df9e4a49 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:52.701270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 900/1788] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:52 2022] POST /identity/v3/users => generated 283 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:52.702915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 889/1789] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:52.705891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a04891-740c-4b05-bffd-d515df9e4a49 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:52.717840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79b0e7-2bed-423a-a93e-6b237de04027 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:52.718211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79b0e7-2bed-423a-a93e-6b237de04027 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:52.718425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79b0e7-2bed-423a-a93e-6b237de04027 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.729529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a04891-740c-4b05-bffd-d515df9e4a49 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:52.732804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 901/1790] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:00:52 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:00:52.765314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b8be2-227d-4d3a-89ec-fcbbe2113fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:52.765954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b8be2-227d-4d3a-89ec-fcbbe2113fbf admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:52.766228 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b8be2-227d-4d3a-89ec-fcbbe2113fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:52.766494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b8be2-227d-4d3a-89ec-fcbbe2113fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.767306 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b8be2-227d-4d3a-89ec-fcbbe2113fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:52.769136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b8be2-227d-4d3a-89ec-fcbbe2113fbf admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:52.804908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 890/1791] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:52.806038 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79b0e7-2bed-423a-a93e-6b237de04027 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:52.841468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79b0e7-2bed-423a-a93e-6b237de04027 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:52.859648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3948b-9574-4036-af94-64ce181590ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:52.859648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3948b-9574-4036-af94-64ce181590ba admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:52.859648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3948b-9574-4036-af94-64ce181590ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:52.859648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3948b-9574-4036-af94-64ce181590ba admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.859942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3948b-9574-4036-af94-64ce181590ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:52.859942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3948b-9574-4036-af94-64ce181590ba admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:52.897352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b8be2-227d-4d3a-89ec-fcbbe2113fbf admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:52.928868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b8be2-227d-4d3a-89ec-fcbbe2113fbf admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:52.934310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 902/1792] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:52.946508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfc450-7853-42f9-b9a4-10e8f8037f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:52.951352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc450-7853-42f9-b9a4-10e8f8037f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:52.952037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc450-7853-42f9-b9a4-10e8f8037f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:52.952371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc450-7853-42f9-b9a4-10e8f8037f41 admin admin] PATH_INFO: `/v3/projects/2fa05e1c59604d4693cb189053832832/users/9c6da8d6bec646a983c5b14e8df48e3d/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.988577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b028a9b-36d7-4408-8e15-b63f51e83092 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:52.988908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b028a9b-36d7-4408-8e15-b63f51e83092 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:52.989188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b028a9b-36d7-4408-8e15-b63f51e83092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:52.990503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfc450-7853-42f9-b9a4-10e8f8037f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa05e1c59604d4693cb189053832832, user_id=9c6da8d6bec646a983c5b14e8df48e3d, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:52.993313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfc450-7853-42f9-b9a4-10e8f8037f41 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:53.055968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2b028a9b-36d7-4408-8e15-b63f51e83092 None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:53.057439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2b028a9b-36d7-4408-8e15-b63f51e83092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:53.113524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 891/1793] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:52 2022] PUT /identity/v3/projects/2fa05e1c59604d4693cb189053832832/users/9c6da8d6bec646a983c5b14e8df48e3d/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:53.123719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b4754-ec6a-4de9-80b1-9611b086da32 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:53.123993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b4754-ec6a-4de9-80b1-9611b086da32 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:53.124414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b4754-ec6a-4de9-80b1-9611b086da32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:53.202123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7b9b4754-ec6a-4de9-80b1-9611b086da32 None None] MFA Rules not processed for user `9c6da8d6bec646a983c5b14e8df48e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:53.203289 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7b9b4754-ec6a-4de9-80b1-9611b086da32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:53.290770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 903/1794] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:00:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:53.293473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9923d-21ec-4762-9538-b507b393a471 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:53.293842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9923d-21ec-4762-9538-b507b393a471 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:53.294175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9923d-21ec-4762-9538-b507b393a471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:53.439228 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-80f9923d-21ec-4762-9538-b507b393a471 None None] MFA Rules not processed for user `5f8353e92dc54d08ae0a82381d6d619d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:53.445169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-80f9923d-21ec-4762-9538-b507b393a471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:53.448370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 892/1795] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:53.449573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b4754-ec6a-4de9-80b1-9611b086da32 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:53.458809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7b9b4754-ec6a-4de9-80b1-9611b086da32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:53.597349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:53.682935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:53.758675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 904/1796] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:53.760731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9923d-21ec-4762-9538-b507b393a471 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:53.833157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b4754-ec6a-4de9-80b1-9611b086da32 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:53.845767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd41fff-5108-4746-a54c-8a7a6933e30d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:53.846869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd41fff-5108-4746-a54c-8a7a6933e30d service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:53.846869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd41fff-5108-4746-a54c-8a7a6933e30d service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:53.847072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd41fff-5108-4746-a54c-8a7a6933e30d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:53.894638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd41fff-5108-4746-a54c-8a7a6933e30d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:53.899143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd41fff-5108-4746-a54c-8a7a6933e30d service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:53.928593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9923d-21ec-4762-9538-b507b393a471 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:53.943614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 893/1797] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:53.946122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9bfd1-97b3-4e09-b588-ec273ef9ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:53.946939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9bfd1-97b3-4e09-b588-ec273ef9ede4 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:53.947338 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9bfd1-97b3-4e09-b588-ec273ef9ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:53.947688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9bfd1-97b3-4e09-b588-ec273ef9ede4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:53.949804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9bfd1-97b3-4e09-b588-ec273ef9ede4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:53.956513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9bfd1-97b3-4e09-b588-ec273ef9ede4 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:54.109459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd41fff-5108-4746-a54c-8a7a6933e30d service nova] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:54.110924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-afd41fff-5108-4746-a54c-8a7a6933e30d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:54.144455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 905/1798] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:53 2022] POST /identity/v3/projects => generated 363 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:54.149260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9bfd1-97b3-4e09-b588-ec273ef9ede4 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:54.168144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd41fff-5108-4746-a54c-8a7a6933e30d service nova] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:54.362590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9bfd1-97b3-4e09-b588-ec273ef9ede4 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:54.367344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:54.368000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:54.368334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:54.368623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] PATH_INFO: `/v3/projects/2ef96bbee75941678c5cdaa6eb11a7b5` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:54.372757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef96bbee75941678c5cdaa6eb11a7b5)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:54.374724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:54.383692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957527f-bf9b-4ce1-b9ff-a488d0bc4972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:54.392063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957527f-bf9b-4ce1-b9ff-a488d0bc4972 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:54.392063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957527f-bf9b-4ce1-b9ff-a488d0bc4972 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:54.392063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957527f-bf9b-4ce1-b9ff-a488d0bc4972 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:54.392063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957527f-bf9b-4ce1-b9ff-a488d0bc4972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:54.392063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957527f-bf9b-4ce1-b9ff-a488d0bc4972 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:54.508489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 906/1799] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:54 2022] POST /identity/v3/users => generated 288 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:00:54.512284 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957527f-bf9b-4ce1-b9ff-a488d0bc4972 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:54.530895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957527f-bf9b-4ce1-b9ff-a488d0bc4972 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:54.537846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f022e65-05fd-4630-a9c4-770fa0b65828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:54.539009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f022e65-05fd-4630-a9c4-770fa0b65828 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:54.539504 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f022e65-05fd-4630-a9c4-770fa0b65828 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:54.539990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f022e65-05fd-4630-a9c4-770fa0b65828 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:54.541010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f022e65-05fd-4630-a9c4-770fa0b65828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:54.564515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f022e65-05fd-4630-a9c4-770fa0b65828 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:54.574932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef96bbee75941678c5cdaa6eb11a7b5', 'request_id': 'req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:54.583939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 907/1800] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:00:54.590346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f022e65-05fd-4630-a9c4-770fa0b65828 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:54.590490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef96bbee75941678c5cdaa6eb11a7b5', 'request_id': 'req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:54.617395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f022e65-05fd-4630-a9c4-770fa0b65828 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:54.694263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef96bbee75941678c5cdaa6eb11a7b5', 'request_id': 'req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:54.711852 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] The token cache is being invalidate because project 2ef96bbee75941678c5cdaa6eb11a7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:54.712162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:54.712906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:54.717099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 894/1801] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:54 2022] DELETE /identity/v3/projects/2ef96bbee75941678c5cdaa6eb11a7b5 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:00:54.719589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:54.726036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:54.731526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:54.735900 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d13a6e-715d-4ebd-ac88-547bba764f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:54.736958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d13a6e-715d-4ebd-ac88-547bba764f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:54.738006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d13a6e-715d-4ebd-ac88-547bba764f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:54.738402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d13a6e-715d-4ebd-ac88-547bba764f1d admin admin] PATH_INFO: `/v3/projects/cf2d2fe35954466480f098bb350ae3bc/users/beabb1423ee24575a5b83170feb0aef4/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:54.761585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d13a6e-715d-4ebd-ac88-547bba764f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2d2fe35954466480f098bb350ae3bc, user_id=beabb1423ee24575a5b83170feb0aef4, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:54.762529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79468dc-3d87-4d7f-b0ec-0f6f3de45ae5 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:54.766113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d13a6e-715d-4ebd-ac88-547bba764f1d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:54.770539 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:54.771384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:54.771671 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:54.771934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] PATH_INFO: `/v3/users/6a0d172a78c04344b128d2df5db182e9` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:54.773340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0d172a78c04344b128d2df5db182e9)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:54.775742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:54.807937 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:54.895870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 908/1802] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:54 2022] PUT /identity/v3/projects/cf2d2fe35954466480f098bb350ae3bc/users/beabb1423ee24575a5b83170feb0aef4/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:54.897181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d13a6e-715d-4ebd-ac88-547bba764f1d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:54.899840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-02d13a6e-715d-4ebd-ac88-547bba764f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:55.035113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d13a6e-715d-4ebd-ac88-547bba764f1d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:55.042215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9ef8f-192b-4bf2-bb50-87dc7bf6eb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:55.042964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ef8f-192b-4bf2-bb50-87dc7bf6eb3f admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:55.043082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ef8f-192b-4bf2-bb50-87dc7bf6eb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:55.043343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ef8f-192b-4bf2-bb50-87dc7bf6eb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:55.044126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9ef8f-192b-4bf2-bb50-87dc7bf6eb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:55.045956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9ef8f-192b-4bf2-bb50-87dc7bf6eb3f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:55.050354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0d172a78c04344b128d2df5db182e9'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:55.058940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 909/1803] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:55.066280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9ef8f-192b-4bf2-bb50-87dc7bf6eb3f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:55.075297 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0d172a78c04344b128d2df5db182e9'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:55.109483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9ef8f-192b-4bf2-bb50-87dc7bf6eb3f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:55.118221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b6c4c-902a-415e-905a-cfceab38df34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:55.118962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b6c4c-902a-415e-905a-cfceab38df34 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:55.119246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b6c4c-902a-415e-905a-cfceab38df34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:55.119522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b6c4c-902a-415e-905a-cfceab38df34 admin admin] PATH_INFO: `/v3/projects/cf2d2fe35954466480f098bb350ae3bc/users/beabb1423ee24575a5b83170feb0aef4/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:55.122581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b6c4c-902a-415e-905a-cfceab38df34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2d2fe35954466480f098bb350ae3bc, user_id=beabb1423ee24575a5b83170feb0aef4, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:55.126213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b6c4c-902a-415e-905a-cfceab38df34 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:55.132089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0d172a78c04344b128d2df5db182e9'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:55.134660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0d172a78c04344b128d2df5db182e9'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:55.136769 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4ab14592-2953-4741-8a4b-e7173423ef3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0d172a78c04344b128d2df5db182e9'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:55.152313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 910/1804] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:55 2022] PUT /identity/v3/projects/cf2d2fe35954466480f098bb350ae3bc/users/beabb1423ee24575a5b83170feb0aef4/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:55.170433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881881d0-4969-4f2e-a010-98a65854b865 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:55.170433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881881d0-4969-4f2e-a010-98a65854b865 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:55.170433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881881d0-4969-4f2e-a010-98a65854b865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:55.215757 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-881881d0-4969-4f2e-a010-98a65854b865 None None] MFA Rules not processed for user `beabb1423ee24575a5b83170feb0aef4`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:55.217500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-881881d0-4969-4f2e-a010-98a65854b865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:55.271469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 895/1805] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:00:54 2022] DELETE /identity/v3/users/6a0d172a78c04344b128d2df5db182e9 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:00:55.272434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977df5-1a8e-45d0-866a-e2fd8dad988e None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:55.272556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977df5-1a8e-45d0-866a-e2fd8dad988e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:55.272791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977df5-1a8e-45d0-866a-e2fd8dad988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:55.321182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-60977df5-1a8e-45d0-866a-e2fd8dad988e None None] MFA Rules not processed for user `03403068f7da491499f2a62ad218159e`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:55.322435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-60977df5-1a8e-45d0-866a-e2fd8dad988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:55.455068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 911/1806] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:00:55.482536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881881d0-4969-4f2e-a010-98a65854b865 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:55.484050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-881881d0-4969-4f2e-a010-98a65854b865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:55.528706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 896/1807] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:55.688289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:55.709764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881881d0-4969-4f2e-a010-98a65854b865 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:55.860126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df2d96-47d7-4a17-86bb-c2bcfb9c2cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:55.864586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df2d96-47d7-4a17-86bb-c2bcfb9c2cdb service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:55.865248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df2d96-47d7-4a17-86bb-c2bcfb9c2cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:55.865380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df2d96-47d7-4a17-86bb-c2bcfb9c2cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:56.026568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df2d96-47d7-4a17-86bb-c2bcfb9c2cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:56.028101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df2d96-47d7-4a17-86bb-c2bcfb9c2cdb service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:56.058106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 912/1808] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:56.309581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60977df5-1a8e-45d0-866a-e2fd8dad988e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:56.311077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-60977df5-1a8e-45d0-866a-e2fd8dad988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:56.484734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60977df5-1a8e-45d0-866a-e2fd8dad988e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:56.502958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:56.503893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:56.504319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:56.504734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] PATH_INFO: `/v3/projects/ee37416a40b04f338acca49c556aba2a` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:56.508973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee37416a40b04f338acca49c556aba2a)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:56.511851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:56.642816 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df2d96-47d7-4a17-86bb-c2bcfb9c2cdb service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:56.645146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f1df2d96-47d7-4a17-86bb-c2bcfb9c2cdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:56.664743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df2d96-47d7-4a17-86bb-c2bcfb9c2cdb service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:56.675480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52887184-32f9-4d01-b030-52db7c6a99c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:56.676916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52887184-32f9-4d01-b030-52db7c6a99c3 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:56.679183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52887184-32f9-4d01-b030-52db7c6a99c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:56.680002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52887184-32f9-4d01-b030-52db7c6a99c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:56.683334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-52887184-32f9-4d01-b030-52db7c6a99c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:56.754737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:56.763922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee37416a40b04f338acca49c556aba2a', 'request_id': 'req-68db9759-7a7e-42cc-bd25-7888227d184f'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:56.791067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee37416a40b04f338acca49c556aba2a', 'request_id': 'req-68db9759-7a7e-42cc-bd25-7888227d184f'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:56.839526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52887184-32f9-4d01-b030-52db7c6a99c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:56.842271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52887184-32f9-4d01-b030-52db7c6a99c3 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:56.866581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 913/1809] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:00:56.970269 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee37416a40b04f338acca49c556aba2a', 'request_id': 'req-68db9759-7a7e-42cc-bd25-7888227d184f'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:56.987459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] The token cache is being invalidate because project ee37416a40b04f338acca49c556aba2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:00:56.987759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:56.993322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-68db9759-7a7e-42cc-bd25-7888227d184f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:00:56.998910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 897/1810] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:56 2022] DELETE /identity/v3/projects/ee37416a40b04f338acca49c556aba2a => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:57.000808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba99ea-a473-4544-b417-bc8740ad001f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:57.001189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba99ea-a473-4544-b417-bc8740ad001f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:57.001493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba99ea-a473-4544-b417-bc8740ad001f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:57.025928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-95ba99ea-a473-4544-b417-bc8740ad001f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:57.027594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-95ba99ea-a473-4544-b417-bc8740ad001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:57.110827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:57.158735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 914/1811] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:57.169516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f80d-79e1-449d-8f39-19d009b229ff None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:57.169516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f80d-79e1-449d-8f39-19d009b229ff None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:57.169516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7f80d-79e1-449d-8f39-19d009b229ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:57.205582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f3d7f80d-79e1-449d-8f39-19d009b229ff None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:57.207251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f3d7f80d-79e1-449d-8f39-19d009b229ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:57.233513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 898/1812] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:57.234472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba99ea-a473-4544-b417-bc8740ad001f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:57.261032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba99ea-a473-4544-b417-bc8740ad001f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:57.289392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea48883-6008-420c-bfc0-6a17d1114fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:57.290432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea48883-6008-420c-bfc0-6a17d1114fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:57.290723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea48883-6008-420c-bfc0-6a17d1114fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:57.291157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea48883-6008-420c-bfc0-6a17d1114fa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:57.294071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea48883-6008-420c-bfc0-6a17d1114fa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:00:57.295457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea48883-6008-420c-bfc0-6a17d1114fa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:57.305197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea48883-6008-420c-bfc0-6a17d1114fa8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:57.338420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 915/1813] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:00:57.343906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7f80d-79e1-449d-8f39-19d009b229ff None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:57.399221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7f80d-79e1-449d-8f39-19d009b229ff None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:57.399221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876c300-833e-45a9-b5b9-cfe2435229ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:57.399221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876c300-833e-45a9-b5b9-cfe2435229ec admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:57.399221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876c300-833e-45a9-b5b9-cfe2435229ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:57.400120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876c300-833e-45a9-b5b9-cfe2435229ec admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:57.400120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876c300-833e-45a9-b5b9-cfe2435229ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:57.400120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876c300-833e-45a9-b5b9-cfe2435229ec admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:57.527474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 899/1814] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:57 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:00:57.528643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea48883-6008-420c-bfc0-6a17d1114fa8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:57.539152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea48883-6008-420c-bfc0-6a17d1114fa8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:57.609304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd5759-a376-4b2d-abfd-f10c582d203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:57.610383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd5759-a376-4b2d-abfd-f10c582d203a admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:57.610823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd5759-a376-4b2d-abfd-f10c582d203a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:57.611224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd5759-a376-4b2d-abfd-f10c582d203a admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:57.612099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd5759-a376-4b2d-abfd-f10c582d203a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:57.614433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd5759-a376-4b2d-abfd-f10c582d203a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:57.701273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 916/1815] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:57 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:57.706725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876c300-833e-45a9-b5b9-cfe2435229ec admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:57.723440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876c300-833e-45a9-b5b9-cfe2435229ec admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:57.729838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ed2ec-bd7f-46b9-bfc4-90aff55ecfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:57.730457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ed2ec-bd7f-46b9-bfc4-90aff55ecfbf admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:57.730735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ed2ec-bd7f-46b9-bfc4-90aff55ecfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:57.731007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ed2ec-bd7f-46b9-bfc4-90aff55ecfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:57.731659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ed2ec-bd7f-46b9-bfc4-90aff55ecfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:57.733405 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ed2ec-bd7f-46b9-bfc4-90aff55ecfbf admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:57.744287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 900/1816] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:57.747966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd5759-a376-4b2d-abfd-f10c582d203a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:57.758627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd5759-a376-4b2d-abfd-f10c582d203a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:57.763860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42befcc6-9c60-4423-ba15-044c7d6f35b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:57.768991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42befcc6-9c60-4423-ba15-044c7d6f35b1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:57.768991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42befcc6-9c60-4423-ba15-044c7d6f35b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:57.768991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42befcc6-9c60-4423-ba15-044c7d6f35b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:57.768991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42befcc6-9c60-4423-ba15-044c7d6f35b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:57.768991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42befcc6-9c60-4423-ba15-044c7d6f35b1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:57.788637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 917/1817] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:57.795345 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ed2ec-bd7f-46b9-bfc4-90aff55ecfbf admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:57.814285 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ed2ec-bd7f-46b9-bfc4-90aff55ecfbf admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:57.819912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb78ae-3803-45f6-80be-7d1ac2aee198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:57.820567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb78ae-3803-45f6-80be-7d1ac2aee198 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:57.821056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb78ae-3803-45f6-80be-7d1ac2aee198 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:57.821365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb78ae-3803-45f6-80be-7d1ac2aee198 admin admin] PATH_INFO: `/v3/projects/5077775b14bd41ddbd04c038ee88b363/users/bbe3d2bfd55345f18173cf70f5a94f93/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:57.840284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb78ae-3803-45f6-80be-7d1ac2aee198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5077775b14bd41ddbd04c038ee88b363, user_id=bbe3d2bfd55345f18173cf70f5a94f93, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:57.842013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb78ae-3803-45f6-80be-7d1ac2aee198 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:57.974572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 901/1818] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:57 2022] PUT /identity/v3/projects/5077775b14bd41ddbd04c038ee88b363/users/bbe3d2bfd55345f18173cf70f5a94f93/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:57.989864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b34c-6396-420f-b35b-a33e4fb6ba9f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:57.989864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b34c-6396-420f-b35b-a33e4fb6ba9f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:57.989864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b34c-6396-420f-b35b-a33e4fb6ba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:58.014802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c5c7b34c-6396-420f-b35b-a33e4fb6ba9f None None] MFA Rules not processed for user `bbe3d2bfd55345f18173cf70f5a94f93`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:58.024151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c5c7b34c-6396-420f-b35b-a33e4fb6ba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:58.102842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 918/1819] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:58.107585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb78ae-3803-45f6-80be-7d1ac2aee198 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:58.191112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb78ae-3803-45f6-80be-7d1ac2aee198 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:58.196085 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb31a4-0d37-4dd9-8078-ebc0c579c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:58.196765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb31a4-0d37-4dd9-8078-ebc0c579c5da admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:58.197002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb31a4-0d37-4dd9-8078-ebc0c579c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:58.197270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb31a4-0d37-4dd9-8078-ebc0c579c5da admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:58.197911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb31a4-0d37-4dd9-8078-ebc0c579c5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:58.199790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb31a4-0d37-4dd9-8078-ebc0c579c5da admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:58.277353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 902/1820] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:00:58 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:58.279196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7b34c-6396-420f-b35b-a33e4fb6ba9f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:58.291700 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7b34c-6396-420f-b35b-a33e4fb6ba9f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:58.354194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:58.378527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be777062-7957-4662-9ea7-91176b50ee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:58.379886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be777062-7957-4662-9ea7-91176b50ee71 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:58.380422 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be777062-7957-4662-9ea7-91176b50ee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:58.381589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be777062-7957-4662-9ea7-91176b50ee71 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:58.382522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be777062-7957-4662-9ea7-91176b50ee71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:58.384863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be777062-7957-4662-9ea7-91176b50ee71 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:58.505342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 919/1821] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:00:58 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:00:58.508057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb31a4-0d37-4dd9-8078-ebc0c579c5da admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:58.521399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb31a4-0d37-4dd9-8078-ebc0c579c5da admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:58.529414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8935c-79d6-4430-9de3-0b663c6f24c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:58.529414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8935c-79d6-4430-9de3-0b663c6f24c1 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:58.529414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8935c-79d6-4430-9de3-0b663c6f24c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:58.529414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8935c-79d6-4430-9de3-0b663c6f24c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:58.529966 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8935c-79d6-4430-9de3-0b663c6f24c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:58.530437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8935c-79d6-4430-9de3-0b663c6f24c1 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:58.543234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 903/1822] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:58.547420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be777062-7957-4662-9ea7-91176b50ee71 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:58.558136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be777062-7957-4662-9ea7-91176b50ee71 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:58.562809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ec7b-a2d1-410b-893c-2c1d9a6215f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:58.563468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ec7b-a2d1-410b-893c-2c1d9a6215f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:58.563745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ec7b-a2d1-410b-893c-2c1d9a6215f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:58.564018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063ec7b-a2d1-410b-893c-2c1d9a6215f3 admin admin] PATH_INFO: `/v3/projects/3c999dc9e4cc4dceae7d8f485402fc12/users/fbf2996efdee47dcb398790fff9bdb6e/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:58.580961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063ec7b-a2d1-410b-893c-2c1d9a6215f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c999dc9e4cc4dceae7d8f485402fc12, user_id=fbf2996efdee47dcb398790fff9bdb6e, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:58.584060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063ec7b-a2d1-410b-893c-2c1d9a6215f3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:58.706273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 920/1823] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:58 2022] PUT /identity/v3/projects/3c999dc9e4cc4dceae7d8f485402fc12/users/fbf2996efdee47dcb398790fff9bdb6e/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:58.710169 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8935c-79d6-4430-9de3-0b663c6f24c1 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:58.720182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8935c-79d6-4430-9de3-0b663c6f24c1 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:58.766435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:58.784036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96d892-c381-450e-b6b1-3c7f2d6d8a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:58.784036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96d892-c381-450e-b6b1-3c7f2d6d8a8e admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:58.784036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96d892-c381-450e-b6b1-3c7f2d6d8a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:58.784036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96d892-c381-450e-b6b1-3c7f2d6d8a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:58.784777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96d892-c381-450e-b6b1-3c7f2d6d8a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:58.786436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96d892-c381-450e-b6b1-3c7f2d6d8a8e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:58.797280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 904/1824] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:00:58.802411 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ec7b-a2d1-410b-893c-2c1d9a6215f3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:58.816013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063ec7b-a2d1-410b-893c-2c1d9a6215f3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:58.822447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e3695-1c34-421e-a086-907ab683738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:58.823118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e3695-1c34-421e-a086-907ab683738a admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:58.823397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e3695-1c34-421e-a086-907ab683738a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:58.823674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e3695-1c34-421e-a086-907ab683738a admin admin] PATH_INFO: `/v3/projects/3c999dc9e4cc4dceae7d8f485402fc12/users/fbf2996efdee47dcb398790fff9bdb6e/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:58.828610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e3695-1c34-421e-a086-907ab683738a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c999dc9e4cc4dceae7d8f485402fc12, user_id=fbf2996efdee47dcb398790fff9bdb6e, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:58.835260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e3695-1c34-421e-a086-907ab683738a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:58.844280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 921/1825] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:00:58 2022] PUT /identity/v3/projects/3c999dc9e4cc4dceae7d8f485402fc12/users/fbf2996efdee47dcb398790fff9bdb6e/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:00:58.860169 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c8b9b-275c-4cf2-88b3-fa90ae45efcf None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:58.862472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c8b9b-275c-4cf2-88b3-fa90ae45efcf None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:58.862472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c8b9b-275c-4cf2-88b3-fa90ae45efcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:58.895857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-de0c8b9b-275c-4cf2-88b3-fa90ae45efcf None None] MFA Rules not processed for user `fbf2996efdee47dcb398790fff9bdb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:00:58.897073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-de0c8b9b-275c-4cf2-88b3-fa90ae45efcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:58.971337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 905/1826] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:00:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:00:58.987214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e3695-1c34-421e-a086-907ab683738a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:00:58.988987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-453e3695-1c34-421e-a086-907ab683738a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:00:59.064191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e3695-1c34-421e-a086-907ab683738a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:00:59.068183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429d5b5-73ee-4b5d-b493-57f54d9bd33b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:00:59.068822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d5b5-73ee-4b5d-b493-57f54d9bd33b service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:00:59.069156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d5b5-73ee-4b5d-b493-57f54d9bd33b service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:00:59.069472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429d5b5-73ee-4b5d-b493-57f54d9bd33b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:00:59.079748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429d5b5-73ee-4b5d-b493-57f54d9bd33b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:00:59.082006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429d5b5-73ee-4b5d-b493-57f54d9bd33b service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:00:59.093766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 922/1827] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:00:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:00.903575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c8b9b-275c-4cf2-88b3-fa90ae45efcf None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:00.974355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c8b9b-275c-4cf2-88b3-fa90ae45efcf None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:00.979190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:00.979818 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:00.980094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:00.980370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] PATH_INFO: `/v3/users/bbe3d2bfd55345f18173cf70f5a94f93` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:00.981539 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe3d2bfd55345f18173cf70f5a94f93)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:00.983469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:01.186426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe3d2bfd55345f18173cf70f5a94f93'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:01.194020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe3d2bfd55345f18173cf70f5a94f93'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:01.204391 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:01.207363 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe3d2bfd55345f18173cf70f5a94f93'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:01.208090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe3d2bfd55345f18173cf70f5a94f93'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:01.208720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe3d2bfd55345f18173cf70f5a94f93'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:01.297158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 906/1828] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:00 2022] DELETE /identity/v3/users/bbe3d2bfd55345f18173cf70f5a94f93 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:01.299000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b7079-5cad-4a70-8ff1-bdf888358734 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:01.299516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b7079-5cad-4a70-8ff1-bdf888358734 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:01.299603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b7079-5cad-4a70-8ff1-bdf888358734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:01.320170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-773b7079-5cad-4a70-8ff1-bdf888358734 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:01.321735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-773b7079-5cad-4a70-8ff1-bdf888358734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:01.386265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 923/1829] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:01.396267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:01.397820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:01.471678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0858-b6aa-4064-8687-61a1ef4c89ca admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:01.475793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d19bd-7194-4b12-aefb-15fcbe6f609e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:01.476423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d19bd-7194-4b12-aefb-15fcbe6f609e service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:01.476690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d19bd-7194-4b12-aefb-15fcbe6f609e service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:01.476973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d19bd-7194-4b12-aefb-15fcbe6f609e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:01.487570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d19bd-7194-4b12-aefb-15fcbe6f609e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:01.489180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d19bd-7194-4b12-aefb-15fcbe6f609e service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:01.499036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 907/1830] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:01.994887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b7079-5cad-4a70-8ff1-bdf888358734 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:01.996441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-773b7079-5cad-4a70-8ff1-bdf888358734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:02.024199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b7079-5cad-4a70-8ff1-bdf888358734 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:02.035808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:02.037844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:02.038201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:02.038534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] PATH_INFO: `/v3/projects/5077775b14bd41ddbd04c038ee88b363` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:02.039859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5077775b14bd41ddbd04c038ee88b363)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:02.042239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:02.155530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:02.167867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5077775b14bd41ddbd04c038ee88b363', 'request_id': 'req-11378dfc-df3e-410c-abcd-e3e6960ae256'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.175556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5077775b14bd41ddbd04c038ee88b363', 'request_id': 'req-11378dfc-df3e-410c-abcd-e3e6960ae256'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.185164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d19bd-7194-4b12-aefb-15fcbe6f609e service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:02.186868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ad5d19bd-7194-4b12-aefb-15fcbe6f609e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:02.200163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d19bd-7194-4b12-aefb-15fcbe6f609e service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:02.241222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5077775b14bd41ddbd04c038ee88b363', 'request_id': 'req-11378dfc-df3e-410c-abcd-e3e6960ae256'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.268755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] The token cache is being invalidate because project 5077775b14bd41ddbd04c038ee88b363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:02.269136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.270043 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.271548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:02.272257 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:02.272379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 924/1831] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:01 2022] DELETE /identity/v3/projects/5077775b14bd41ddbd04c038ee88b363 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:02.272983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:02.273377 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] PATH_INFO: `/v3/users/9c6da8d6bec646a983c5b14e8df48e3d` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:02.274791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6da8d6bec646a983c5b14e8df48e3d)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:02.276308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:02.276702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:02.278819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:02.294443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11378dfc-df3e-410c-abcd-e3e6960ae256 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:02.299937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:02.300596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:02.300964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:02.301243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] PATH_INFO: `/v3/users/fbf2996efdee47dcb398790fff9bdb6e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:02.302407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf2996efdee47dcb398790fff9bdb6e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:02.304395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:02.461566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6da8d6bec646a983c5b14e8df48e3d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.470617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6da8d6bec646a983c5b14e8df48e3d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.481878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf2996efdee47dcb398790fff9bdb6e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.497324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6da8d6bec646a983c5b14e8df48e3d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.498324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6da8d6bec646a983c5b14e8df48e3d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.498460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf2996efdee47dcb398790fff9bdb6e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.499105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c13b0d5b-f75a-4647-b853-43c7abeaf4b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6da8d6bec646a983c5b14e8df48e3d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.499211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf2996efdee47dcb398790fff9bdb6e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.499805 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf2996efdee47dcb398790fff9bdb6e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.574156 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 908/1832] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:02 2022] DELETE /identity/v3/users/9c6da8d6bec646a983c5b14e8df48e3d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:02.578546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13144d83-4cc2-4d6a-bbc8-a9ee47c5e5e9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:02.578838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13144d83-4cc2-4d6a-bbc8-a9ee47c5e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:02.579115 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13144d83-4cc2-4d6a-bbc8-a9ee47c5e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:02.599605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-13144d83-4cc2-4d6a-bbc8-a9ee47c5e5e9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:02.601732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-13144d83-4cc2-4d6a-bbc8-a9ee47c5e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:02.604952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:02.653872 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf2996efdee47dcb398790fff9bdb6e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:02.663108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 909/1833] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:02.667254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 925/1834] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:02 2022] DELETE /identity/v3/users/fbf2996efdee47dcb398790fff9bdb6e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:02.672925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13144d83-4cc2-4d6a-bbc8-a9ee47c5e5e9 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:02.674370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-13144d83-4cc2-4d6a-bbc8-a9ee47c5e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:02.731163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13144d83-4cc2-4d6a-bbc8-a9ee47c5e5e9 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:02.781399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aedcda-583f-4ff4-8622-bc9cde82691d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:02.782001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedcda-583f-4ff4-8622-bc9cde82691d service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:02.782277 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedcda-583f-4ff4-8622-bc9cde82691d service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:02.782538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aedcda-583f-4ff4-8622-bc9cde82691d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:02.843816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aedcda-583f-4ff4-8622-bc9cde82691d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:02.845316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aedcda-583f-4ff4-8622-bc9cde82691d service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:02.855842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 910/1835] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:03.302660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:03.304128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:03.321268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a0a84-67c9-4596-8d18-0c722444191c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:03.326797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:03.327417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:03.327722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:03.327993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] PATH_INFO: `/v3/projects/3c999dc9e4cc4dceae7d8f485402fc12` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:03.329165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c999dc9e4cc4dceae7d8f485402fc12)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:03.331663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:03.422721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c999dc9e4cc4dceae7d8f485402fc12', 'request_id': 'req-376df6b3-484d-4692-9578-daca46dc6dcc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:03.430201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c999dc9e4cc4dceae7d8f485402fc12', 'request_id': 'req-376df6b3-484d-4692-9578-daca46dc6dcc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:03.521983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c999dc9e4cc4dceae7d8f485402fc12', 'request_id': 'req-376df6b3-484d-4692-9578-daca46dc6dcc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:03.532801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] The token cache is being invalidate because project 3c999dc9e4cc4dceae7d8f485402fc12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:03.533609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:03.534226 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:03.535689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 926/1836] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:03 2022] DELETE /identity/v3/projects/3c999dc9e4cc4dceae7d8f485402fc12 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:03.541344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8466-5a8e-4b82-8b66-4b7849ce9733 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:03.541783 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8466-5a8e-4b82-8b66-4b7849ce9733 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:03.541890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8466-5a8e-4b82-8b66-4b7849ce9733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:03.553545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:03.555232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:03.569556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-397f8466-5a8e-4b82-8b66-4b7849ce9733 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:03.570765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-397f8466-5a8e-4b82-8b66-4b7849ce9733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:03.581588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:03.583992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:03.625523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376df6b3-484d-4692-9578-daca46dc6dcc admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:03.630287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:03.631118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:03.631870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:03.632313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] PATH_INFO: `/v3/projects/2fa05e1c59604d4693cb189053832832` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:03.638888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa05e1c59604d4693cb189053832832)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:03.639130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 911/1837] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:03.639237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:03.641653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed559d4b-e0af-4179-b984-c838c3357132 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:03.641936 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed559d4b-e0af-4179-b984-c838c3357132 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:03.642207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed559d4b-e0af-4179-b984-c838c3357132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:03.663175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ed559d4b-e0af-4179-b984-c838c3357132 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:03.665491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ed559d4b-e0af-4179-b984-c838c3357132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:03.673256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 912/1838] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:03.677520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed559d4b-e0af-4179-b984-c838c3357132 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:03.686267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed559d4b-e0af-4179-b984-c838c3357132 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:03.690816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc67ff-0377-4b8f-a688-1a723fb307cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:03.691384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc67ff-0377-4b8f-a688-1a723fb307cf admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:03.691657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc67ff-0377-4b8f-a688-1a723fb307cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:03.691924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc67ff-0377-4b8f-a688-1a723fb307cf admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:03.692547 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc67ff-0377-4b8f-a688-1a723fb307cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:03.692844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc67ff-0377-4b8f-a688-1a723fb307cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:03.694455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc67ff-0377-4b8f-a688-1a723fb307cf admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:03.706550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 913/1839] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:01:03.710641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc67ff-0377-4b8f-a688-1a723fb307cf admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:03.717690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa05e1c59604d4693cb189053832832', 'request_id': 'req-7d25053c-96c5-4a49-a14c-6ff6af572c47'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:03.720299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc67ff-0377-4b8f-a688-1a723fb307cf admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:03.724447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa05e1c59604d4693cb189053832832', 'request_id': 'req-7d25053c-96c5-4a49-a14c-6ff6af572c47'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:03.777033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df60a27-23a3-4fec-9bf8-693431bde158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:03.777674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df60a27-23a3-4fec-9bf8-693431bde158 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:03.777951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df60a27-23a3-4fec-9bf8-693431bde158 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:03.778220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df60a27-23a3-4fec-9bf8-693431bde158 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:03.778831 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df60a27-23a3-4fec-9bf8-693431bde158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:03.780765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df60a27-23a3-4fec-9bf8-693431bde158 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:03.802121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa05e1c59604d4693cb189053832832', 'request_id': 'req-7d25053c-96c5-4a49-a14c-6ff6af572c47'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:03.812833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] The token cache is being invalidate because project 2fa05e1c59604d4693cb189053832832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:03.813118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:03.813782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:03.815338 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 927/1840] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:03 2022] DELETE /identity/v3/projects/2fa05e1c59604d4693cb189053832832 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:03.819131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:03.820395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:03.833122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25053c-96c5-4a49-a14c-6ff6af572c47 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:03.837800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:03.838407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:03.838684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:03.838989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] PATH_INFO: `/v3/users/beabb1423ee24575a5b83170feb0aef4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:03.840098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beabb1423ee24575a5b83170feb0aef4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:03.842064 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:03.895833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 914/1841] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:03 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:03.900054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df60a27-23a3-4fec-9bf8-693431bde158 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:03.901674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4df60a27-23a3-4fec-9bf8-693431bde158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:03.964344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df60a27-23a3-4fec-9bf8-693431bde158 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:03.969239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ece8-4277-4dc3-aaae-0dbf79ba6990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:03.969868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ece8-4277-4dc3-aaae-0dbf79ba6990 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:03.970144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ece8-4277-4dc3-aaae-0dbf79ba6990 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:03.970420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3ece8-4277-4dc3-aaae-0dbf79ba6990 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:03.971645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3ece8-4277-4dc3-aaae-0dbf79ba6990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:03.973568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3ece8-4277-4dc3-aaae-0dbf79ba6990 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:04.097735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 915/1842] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:03 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:04.098684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ece8-4277-4dc3-aaae-0dbf79ba6990 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:04.119946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3ece8-4277-4dc3-aaae-0dbf79ba6990 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:04.123693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beabb1423ee24575a5b83170feb0aef4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:04.124846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c6813-da8a-4f8e-9da8-3bd6a62e94ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:04.125414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c6813-da8a-4f8e-9da8-3bd6a62e94ff admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:04.125686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c6813-da8a-4f8e-9da8-3bd6a62e94ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:04.126474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c6813-da8a-4f8e-9da8-3bd6a62e94ff admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:04.126657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c6813-da8a-4f8e-9da8-3bd6a62e94ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:04.128804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c6813-da8a-4f8e-9da8-3bd6a62e94ff admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:04.134736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:04.140401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 916/1843] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:04.144498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beabb1423ee24575a5b83170feb0aef4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:04.144869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c6813-da8a-4f8e-9da8-3bd6a62e94ff admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:04.146378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beabb1423ee24575a5b83170feb0aef4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:04.147135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beabb1423ee24575a5b83170feb0aef4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:04.155793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c6813-da8a-4f8e-9da8-3bd6a62e94ff admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:04.160501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fc6e2-d004-4cdf-968e-1596a6b836b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:04.161064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fc6e2-d004-4cdf-968e-1596a6b836b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:04.161347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fc6e2-d004-4cdf-968e-1596a6b836b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:04.164601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fc6e2-d004-4cdf-968e-1596a6b836b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:04.164601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fc6e2-d004-4cdf-968e-1596a6b836b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:04.164601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fc6e2-d004-4cdf-968e-1596a6b836b8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:04.178365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 917/1844] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:04.179272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fc6e2-d004-4cdf-968e-1596a6b836b8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:04.191766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-142fc6e2-d004-4cdf-968e-1596a6b836b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:04.206179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fc6e2-d004-4cdf-968e-1596a6b836b8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:04.212155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b79bfd-a762-4c1a-9072-e800957b127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:04.212809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79bfd-a762-4c1a-9072-e800957b127d admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:04.213082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79bfd-a762-4c1a-9072-e800957b127d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:04.213372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79bfd-a762-4c1a-9072-e800957b127d admin admin] PATH_INFO: `/v3/projects/fa145f25532e422bb9820c48b15802fa/users/f17512645dc748668994cb1fc7c048ad/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:04.224920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b007d9e1-ebfb-49cd-ac76-720e61e3e885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beabb1423ee24575a5b83170feb0aef4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:04.234350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b79bfd-a762-4c1a-9072-e800957b127d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa145f25532e422bb9820c48b15802fa, user_id=f17512645dc748668994cb1fc7c048ad, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:04.262130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b79bfd-a762-4c1a-9072-e800957b127d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:04.262651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 928/1845] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:03 2022] DELETE /identity/v3/users/beabb1423ee24575a5b83170feb0aef4 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:04.323135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 918/1846] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:04 2022] PUT /identity/v3/projects/fa145f25532e422bb9820c48b15802fa/users/f17512645dc748668994cb1fc7c048ad/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:04.334274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee754-5b37-4d3d-aa23-c97667484a6b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:04.335067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee754-5b37-4d3d-aa23-c97667484a6b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:04.335335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee754-5b37-4d3d-aa23-c97667484a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:04.367996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d43ee754-5b37-4d3d-aa23-c97667484a6b None None] MFA Rules not processed for user `f17512645dc748668994cb1fc7c048ad`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:04.369548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d43ee754-5b37-4d3d-aa23-c97667484a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:04.383399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:04.457743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 929/1847] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:04.469623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b79bfd-a762-4c1a-9072-e800957b127d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:04.471256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-05b79bfd-a762-4c1a-9072-e800957b127d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:04.543726 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b79bfd-a762-4c1a-9072-e800957b127d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:04.553773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2b7d1-f7b5-4409-b1dd-c1c6016e96e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:04.555066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2b7d1-f7b5-4409-b1dd-c1c6016e96e2 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:04.555520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2b7d1-f7b5-4409-b1dd-c1c6016e96e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:04.555856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2b7d1-f7b5-4409-b1dd-c1c6016e96e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:04.568786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2b7d1-f7b5-4409-b1dd-c1c6016e96e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:04.570573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2b7d1-f7b5-4409-b1dd-c1c6016e96e2 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:04.582962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 919/1848] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:04.606771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee754-5b37-4d3d-aa23-c97667484a6b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:04.700273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee754-5b37-4d3d-aa23-c97667484a6b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:04.705337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:04.705981 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:04.706257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:04.706523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] PATH_INFO: `/v3/users/f17512645dc748668994cb1fc7c048ad` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:04.707702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17512645dc748668994cb1fc7c048ad)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:04.709788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:04.744810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2b7d1-f7b5-4409-b1dd-c1c6016e96e2 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:04.746782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fed2b7d1-f7b5-4409-b1dd-c1c6016e96e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:04.762256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2b7d1-f7b5-4409-b1dd-c1c6016e96e2 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:04.767323 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:04.768023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:04.769800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:04.769800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] PATH_INFO: `/v3/projects/cf2d2fe35954466480f098bb350ae3bc` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:04.770161 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2d2fe35954466480f098bb350ae3bc)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:04.771872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:04.965182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17512645dc748668994cb1fc7c048ad'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:04.981122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17512645dc748668994cb1fc7c048ad'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:04.992792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2d2fe35954466480f098bb350ae3bc', 'request_id': 'req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:04.993115 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17512645dc748668994cb1fc7c048ad'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:04.993115 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17512645dc748668994cb1fc7c048ad'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:04.993458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2d2fe35954466480f098bb350ae3bc', 'request_id': 'req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:05.111186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17512645dc748668994cb1fc7c048ad'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:05.127093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 930/1849] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:04 2022] DELETE /identity/v3/users/f17512645dc748668994cb1fc7c048ad => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:05.130801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:05.132167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:05.171870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:05.200802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d246c32-3bee-43ea-9c79-69d357acaeb9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:05.206096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:05.206722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.207000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.207274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] PATH_INFO: `/v3/users/72b6086749424468b25e52292eebf558` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.208410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b6086749424468b25e52292eebf558)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:05.210340 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:05.213470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2d2fe35954466480f098bb350ae3bc', 'request_id': 'req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:05.227260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] The token cache is being invalidate because project cf2d2fe35954466480f098bb350ae3bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:05.227571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:05.228216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8b63a9f0-d526-40d8-9a35-e17bc76fa55c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:05.233063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 920/1850] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:04 2022] DELETE /identity/v3/projects/cf2d2fe35954466480f098bb350ae3bc => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:05.233063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d5293-af6e-436b-8798-1867e8b5e4ef None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.233063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d5293-af6e-436b-8798-1867e8b5e4ef None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.233063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d5293-af6e-436b-8798-1867e8b5e4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.253166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-234d5293-af6e-436b-8798-1867e8b5e4ef None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:05.256090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-234d5293-af6e-436b-8798-1867e8b5e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:05.265598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 921/1851] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:05.270948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9543a5-409d-446e-99f8-90fdbd37c3bc None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.270948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9543a5-409d-446e-99f8-90fdbd37c3bc None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.270948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9543a5-409d-446e-99f8-90fdbd37c3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.288856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-6c9543a5-409d-446e-99f8-90fdbd37c3bc None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:05.290157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6c9543a5-409d-446e-99f8-90fdbd37c3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:05.298040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 922/1852] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:05.298953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9543a5-409d-446e-99f8-90fdbd37c3bc None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:05.300154 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6c9543a5-409d-446e-99f8-90fdbd37c3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:05.340231 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:05.356031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9543a5-409d-446e-99f8-90fdbd37c3bc None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:05.359555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df6db8-d9b9-4e71-ade2-9ccde4054b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:05.360152 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df6db8-d9b9-4e71-ade2-9ccde4054b5c service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.360426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df6db8-d9b9-4e71-ade2-9ccde4054b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.360695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df6db8-d9b9-4e71-ade2-9ccde4054b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.369551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df6db8-d9b9-4e71-ade2-9ccde4054b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:05.370992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df6db8-d9b9-4e71-ade2-9ccde4054b5c service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:05.380124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 923/1853] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:05.381456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc88cc-eac9-4f04-bfa7-a46657810a84 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.381725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc88cc-eac9-4f04-bfa7-a46657810a84 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.382070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc88cc-eac9-4f04-bfa7-a46657810a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.402053 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-52dc88cc-eac9-4f04-bfa7-a46657810a84 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:05.403280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-52dc88cc-eac9-4f04-bfa7-a46657810a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:05.407422 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b6086749424468b25e52292eebf558'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:05.412290 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 924/1854] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:05.418602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc88cc-eac9-4f04-bfa7-a46657810a84 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:05.422459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b6086749424468b25e52292eebf558'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:05.422976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b6086749424468b25e52292eebf558'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:05.423637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b6086749424468b25e52292eebf558'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:05.426321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc88cc-eac9-4f04-bfa7-a46657810a84 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:05.431804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd6b5d-73a4-4323-a989-f6086f7e4098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:05.432663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6b5d-73a4-4323-a989-f6086f7e4098 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.433043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6b5d-73a4-4323-a989-f6086f7e4098 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.433339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6b5d-73a4-4323-a989-f6086f7e4098 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.433987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd6b5d-73a4-4323-a989-f6086f7e4098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:05.434313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd6b5d-73a4-4323-a989-f6086f7e4098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:05.444836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd6b5d-73a4-4323-a989-f6086f7e4098 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:05.452124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 925/1855] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:05.452910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd6b5d-73a4-4323-a989-f6086f7e4098 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:05.454769 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-aefd6b5d-73a4-4323-a989-f6086f7e4098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:05.468761 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd6b5d-73a4-4323-a989-f6086f7e4098 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:05.475135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b1b67-508f-40ce-b89a-530659e7cf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:05.475743 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1b67-508f-40ce-b89a-530659e7cf32 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.476020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1b67-508f-40ce-b89a-530659e7cf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.476291 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b1b67-508f-40ce-b89a-530659e7cf32 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.476914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b1b67-508f-40ce-b89a-530659e7cf32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:05.478821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b1b67-508f-40ce-b89a-530659e7cf32 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:05.510727 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cda85155-cf48-4455-b4e1-2d97833b1483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b6086749424468b25e52292eebf558'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:05.527265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 931/1856] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:05 2022] DELETE /identity/v3/users/72b6086749424468b25e52292eebf558 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:05.531535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7501cc7-1888-44da-ae1d-0e7df1fde956 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.531985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7501cc7-1888-44da-ae1d-0e7df1fde956 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.532260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7501cc7-1888-44da-ae1d-0e7df1fde956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.555511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b7501cc7-1888-44da-ae1d-0e7df1fde956 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:05.557302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b7501cc7-1888-44da-ae1d-0e7df1fde956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:05.583386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 926/1857] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:05 2022] POST /identity/v3/projects => generated 401 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:05.588162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b1b67-508f-40ce-b89a-530659e7cf32 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:05.629632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 932/1858] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:05.658083 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7501cc7-1888-44da-ae1d-0e7df1fde956 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:05.663641 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b7501cc7-1888-44da-ae1d-0e7df1fde956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:05.668053 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b1b67-508f-40ce-b89a-530659e7cf32 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:05.674385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e8424-4662-482e-a861-ee5b80c97c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:05.675254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e8424-4662-482e-a861-ee5b80c97c33 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.675254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e8424-4662-482e-a861-ee5b80c97c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.675530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e8424-4662-482e-a861-ee5b80c97c33 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.676389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e8424-4662-482e-a861-ee5b80c97c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:05.678696 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e8424-4662-482e-a861-ee5b80c97c33 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:05.728037 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7501cc7-1888-44da-ae1d-0e7df1fde956 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:05.767185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 927/1859] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:05 2022] POST /identity/v3/users => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:05.769951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e8424-4662-482e-a861-ee5b80c97c33 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:05.783588 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e8424-4662-482e-a861-ee5b80c97c33 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:05.786984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b5d5c-76c7-4715-a28a-a6bc099d05f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:05.787698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b5d5c-76c7-4715-a28a-a6bc099d05f4 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.787979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b5d5c-76c7-4715-a28a-a6bc099d05f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.788249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b5d5c-76c7-4715-a28a-a6bc099d05f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.790586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf6f7-30d4-4e1b-8dbf-ddee6cc492ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:05.791633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf6f7-30d4-4e1b-8dbf-ddee6cc492ac admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.792370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf6f7-30d4-4e1b-8dbf-ddee6cc492ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.792870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf6f7-30d4-4e1b-8dbf-ddee6cc492ac admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.793870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cf6f7-30d4-4e1b-8dbf-ddee6cc492ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:05.795695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cf6f7-30d4-4e1b-8dbf-ddee6cc492ac admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:05.798681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b5d5c-76c7-4715-a28a-a6bc099d05f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:05.800116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b5d5c-76c7-4715-a28a-a6bc099d05f4 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:05.807493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 928/1860] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:05.811004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 933/1861] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:05.811832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf6f7-30d4-4e1b-8dbf-ddee6cc492ac admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:05.823642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf6f7-30d4-4e1b-8dbf-ddee6cc492ac admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:05.828857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfc318-8e5c-41e0-a126-1ead3f4afbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:05.832836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfc318-8e5c-41e0-a126-1ead3f4afbfb admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.832836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfc318-8e5c-41e0-a126-1ead3f4afbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.832836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfc318-8e5c-41e0-a126-1ead3f4afbfb admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.832836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfc318-8e5c-41e0-a126-1ead3f4afbfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:05.833253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfc318-8e5c-41e0-a126-1ead3f4afbfb admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:05.844569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 929/1862] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:05.848835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b5d5c-76c7-4715-a28a-a6bc099d05f4 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:05.858817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b5d5c-76c7-4715-a28a-a6bc099d05f4 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:05.864092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdbaa9-9be4-402c-aca9-f0e0b9e28a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:05.864741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdbaa9-9be4-402c-aca9-f0e0b9e28a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:05.865013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdbaa9-9be4-402c-aca9-f0e0b9e28a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:05.865283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdbaa9-9be4-402c-aca9-f0e0b9e28a73 admin admin] PATH_INFO: `/v3/projects/cf6884a4864c4b59a47f3011de8f41a0/users/3562bc0e4c3242e9ba8c27499c72e37e/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:05.880617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdbaa9-9be4-402c-aca9-f0e0b9e28a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6884a4864c4b59a47f3011de8f41a0, user_id=3562bc0e4c3242e9ba8c27499c72e37e, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:05.883348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdbaa9-9be4-402c-aca9-f0e0b9e28a73 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:06.077449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 934/1863] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:05 2022] PUT /identity/v3/projects/cf6884a4864c4b59a47f3011de8f41a0/users/3562bc0e4c3242e9ba8c27499c72e37e/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:06.089095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ce18c-3413-41d2-b22c-f249aa835ce7 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:06.089387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ce18c-3413-41d2-b22c-f249aa835ce7 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:06.089658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ce18c-3413-41d2-b22c-f249aa835ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:06.118508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-d93ce18c-3413-41d2-b22c-f249aa835ce7 None None] MFA Rules not processed for user `3562bc0e4c3242e9ba8c27499c72e37e`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:06.119715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d93ce18c-3413-41d2-b22c-f249aa835ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:06.128092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:06.164063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdbaa9-9be4-402c-aca9-f0e0b9e28a73 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:06.171177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2afdbaa9-9be4-402c-aca9-f0e0b9e28a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:06.199856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 930/1864] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:06 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:06.204301 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ce18c-3413-41d2-b22c-f249aa835ce7 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:06.259270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:06.284990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdbaa9-9be4-402c-aca9-f0e0b9e28a73 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:06.299197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:06.301193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:06.301489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:06.301757 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] PATH_INFO: `/v3/projects/fa145f25532e422bb9820c48b15802fa` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:06.306254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa145f25532e422bb9820c48b15802fa)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:06.308047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ce18c-3413-41d2-b22c-f249aa835ce7 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:06.308264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:06.329565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a2e84-cbf3-4192-9e03-6ae3cd904ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:06.329565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a2e84-cbf3-4192-9e03-6ae3cd904ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:06.329565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a2e84-cbf3-4192-9e03-6ae3cd904ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:06.329565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a2e84-cbf3-4192-9e03-6ae3cd904ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:06.330722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a2e84-cbf3-4192-9e03-6ae3cd904ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:06.330722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a2e84-cbf3-4192-9e03-6ae3cd904ec9 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:06.407562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa145f25532e422bb9820c48b15802fa', 'request_id': 'req-48a34f72-ef28-4a3f-87a6-9e866151d6ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:06.414834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa145f25532e422bb9820c48b15802fa', 'request_id': 'req-48a34f72-ef28-4a3f-87a6-9e866151d6ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:06.429505 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 931/1865] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:06 2022] POST /identity/v3/projects => generated 401 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:06.434965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a2e84-cbf3-4192-9e03-6ae3cd904ec9 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:06.524413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a2e84-cbf3-4192-9e03-6ae3cd904ec9 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:06.529251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85944cb4-6f09-45de-90c4-29217821737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:06.529911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85944cb4-6f09-45de-90c4-29217821737c admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:06.530187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85944cb4-6f09-45de-90c4-29217821737c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:06.530463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85944cb4-6f09-45de-90c4-29217821737c admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:06.531095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85944cb4-6f09-45de-90c4-29217821737c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:06.533064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85944cb4-6f09-45de-90c4-29217821737c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:06.533938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa145f25532e422bb9820c48b15802fa', 'request_id': 'req-48a34f72-ef28-4a3f-87a6-9e866151d6ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:06.547144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] The token cache is being invalidate because project fa145f25532e422bb9820c48b15802fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:06.547704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:06.548619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-48a34f72-ef28-4a3f-87a6-9e866151d6ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:06.550353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 935/1866] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:06 2022] DELETE /identity/v3/projects/fa145f25532e422bb9820c48b15802fa => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:06.554977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a954d-a971-491f-beff-2f77ce148e22 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:06.555429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a954d-a971-491f-beff-2f77ce148e22 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:06.555918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a954d-a971-491f-beff-2f77ce148e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:06.585410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2d6a954d-a971-491f-beff-2f77ce148e22 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:06.586632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2d6a954d-a971-491f-beff-2f77ce148e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:06.596067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 936/1867] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:06.603996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a954d-a971-491f-beff-2f77ce148e22 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:06.605424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2d6a954d-a971-491f-beff-2f77ce148e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:06.618576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a954d-a971-491f-beff-2f77ce148e22 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:06.623370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:06.624001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:06.624275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:06.624547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] PATH_INFO: `/v3/projects/aad6ce3578c244bc8be39f0c8d24c391` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:06.625708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad6ce3578c244bc8be39f0c8d24c391)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:06.628189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:06.654926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 932/1868] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:06 2022] POST /identity/v3/users => generated 307 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:06.657703 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba14d3-2160-49d8-bce6-9248d07ed610 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:06.658541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba14d3-2160-49d8-bce6-9248d07ed610 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:06.659998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba14d3-2160-49d8-bce6-9248d07ed610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:06.689022 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-d0ba14d3-2160-49d8-bce6-9248d07ed610 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:06.691859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d0ba14d3-2160-49d8-bce6-9248d07ed610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:06.704151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 933/1869] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:06.704500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba14d3-2160-49d8-bce6-9248d07ed610 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:06.706063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d0ba14d3-2160-49d8-bce6-9248d07ed610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:06.725485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba14d3-2160-49d8-bce6-9248d07ed610 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:06.739858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23699b-acc5-49e3-861f-3b5f5675d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:06.740695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23699b-acc5-49e3-861f-3b5f5675d633 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:06.741241 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23699b-acc5-49e3-861f-3b5f5675d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:06.741705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23699b-acc5-49e3-861f-3b5f5675d633 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:06.743991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23699b-acc5-49e3-861f-3b5f5675d633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:06.746036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23699b-acc5-49e3-861f-3b5f5675d633 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:06.761852 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 934/1870] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:06.762875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23699b-acc5-49e3-861f-3b5f5675d633 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:06.777719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23699b-acc5-49e3-861f-3b5f5675d633 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:06.784131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860b30f-7c00-416d-8cbd-9c9f3bc848a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:06.785120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860b30f-7c00-416d-8cbd-9c9f3bc848a6 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:06.785631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860b30f-7c00-416d-8cbd-9c9f3bc848a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:06.786151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860b30f-7c00-416d-8cbd-9c9f3bc848a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:06.787475 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860b30f-7c00-416d-8cbd-9c9f3bc848a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:06.787917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860b30f-7c00-416d-8cbd-9c9f3bc848a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:06.789616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860b30f-7c00-416d-8cbd-9c9f3bc848a6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:06.810200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 935/1871] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:06.811128 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860b30f-7c00-416d-8cbd-9c9f3bc848a6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:06.825810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860b30f-7c00-416d-8cbd-9c9f3bc848a6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:06.839574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad6ce3578c244bc8be39f0c8d24c391', 'request_id': 'req-b32b9351-5461-4f7b-b02f-f984261ac8f7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:06.867984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad6ce3578c244bc8be39f0c8d24c391', 'request_id': 'req-b32b9351-5461-4f7b-b02f-f984261ac8f7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:06.905537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef042e-dda7-4bb9-bd3f-4235c0e10ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:06.912046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef042e-dda7-4bb9-bd3f-4235c0e10ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:06.912046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef042e-dda7-4bb9-bd3f-4235c0e10ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:06.912046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef042e-dda7-4bb9-bd3f-4235c0e10ddb admin admin] PATH_INFO: `/v3/projects/bbdbdf3c58de41d681fc1faca2eb8132/users/7ff91af87de64930b0215d82f7d2647c/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:06.922889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef042e-dda7-4bb9-bd3f-4235c0e10ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbdf3c58de41d681fc1faca2eb8132, user_id=7ff91af87de64930b0215d82f7d2647c, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:06.926130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef042e-dda7-4bb9-bd3f-4235c0e10ddb admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:06.979421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad6ce3578c244bc8be39f0c8d24c391', 'request_id': 'req-b32b9351-5461-4f7b-b02f-f984261ac8f7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:06.992147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] The token cache is being invalidate because project aad6ce3578c244bc8be39f0c8d24c391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:06.992446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:06.993626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:06.994979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 937/1872] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:06 2022] DELETE /identity/v3/projects/aad6ce3578c244bc8be39f0c8d24c391 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:06.995710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:06.997039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:07.012891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b9351-5461-4f7b-b02f-f984261ac8f7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:07.021283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626cec-d851-4387-a959-53748f205300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:07.021922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626cec-d851-4387-a959-53748f205300 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:07.022202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626cec-d851-4387-a959-53748f205300 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:07.022471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626cec-d851-4387-a959-53748f205300 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:07.023124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d626cec-d851-4387-a959-53748f205300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:07.025783 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d626cec-d851-4387-a959-53748f205300 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:07.129613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 936/1873] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:06 2022] PUT /identity/v3/projects/bbdbdf3c58de41d681fc1faca2eb8132/users/7ff91af87de64930b0215d82f7d2647c/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:07.131145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f069a-228b-45f0-9c63-a3a0871ee46f None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:07.131483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f069a-228b-45f0-9c63-a3a0871ee46f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:07.131807 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f069a-228b-45f0-9c63-a3a0871ee46f None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:07.133159 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 937/1874] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:01:07.135770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f069a-228b-45f0-9c63-a3a0871ee46f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:07.137886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f13f069a-228b-45f0-9c63-a3a0871ee46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:07.183414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 938/1875] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:06 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:07.184556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626cec-d851-4387-a959-53748f205300 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:07.188269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1d626cec-d851-4387-a959-53748f205300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:07.242653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f069a-228b-45f0-9c63-a3a0871ee46f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:07.278828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626cec-d851-4387-a959-53748f205300 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:07.284573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:07.290879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d5978-4271-4d1e-a7a2-4d9de5a58d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:07.291863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d5978-4271-4d1e-a7a2-4d9de5a58d7b admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:07.293177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d5978-4271-4d1e-a7a2-4d9de5a58d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:07.294050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d5978-4271-4d1e-a7a2-4d9de5a58d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:07.295934 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d5978-4271-4d1e-a7a2-4d9de5a58d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:07.297818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d5978-4271-4d1e-a7a2-4d9de5a58d7b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:07.309653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 939/1876] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:07.314343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14151b-3eff-48b4-9044-5604d0649cc1 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:07.314628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14151b-3eff-48b4-9044-5604d0649cc1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:07.314901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14151b-3eff-48b4-9044-5604d0649cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:07.350173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fc14151b-3eff-48b4-9044-5604d0649cc1 None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:07.351474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fc14151b-3eff-48b4-9044-5604d0649cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:07.364383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:07.365237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:07.365512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:07.365782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] PATH_INFO: `/v3/users/d01ea265e9174e9b8628e77fe07bc1e7` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:07.367062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d01ea265e9174e9b8628e77fe07bc1e7)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:07.369610 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:07.558197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 940/1877] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:01:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:07.558893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14151b-3eff-48b4-9044-5604d0649cc1 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:07.569668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14151b-3eff-48b4-9044-5604d0649cc1 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:07.574608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14400dcd-2d8e-4927-996d-3362cd7718d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:07.575621 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400dcd-2d8e-4927-996d-3362cd7718d3 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:07.575984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400dcd-2d8e-4927-996d-3362cd7718d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:07.576402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14400dcd-2d8e-4927-996d-3362cd7718d3 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:07.577948 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14400dcd-2d8e-4927-996d-3362cd7718d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:07.581128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14400dcd-2d8e-4927-996d-3362cd7718d3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:07.716536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 941/1878] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:07 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:07.717790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14400dcd-2d8e-4927-996d-3362cd7718d3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:07.728507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14400dcd-2d8e-4927-996d-3362cd7718d3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:07.733601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fc60d-bdd1-4619-ab71-309a0c4d2c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:07.734709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fc60d-bdd1-4619-ab71-309a0c4d2c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:07.734709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fc60d-bdd1-4619-ab71-309a0c4d2c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:07.734937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fc60d-bdd1-4619-ab71-309a0c4d2c33 admin admin] PATH_INFO: `/v3/projects/bbdbdf3c58de41d681fc1faca2eb8132/users/7ff91af87de64930b0215d82f7d2647c/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:07.736959 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fc60d-bdd1-4619-ab71-309a0c4d2c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbdf3c58de41d681fc1faca2eb8132, user_id=7ff91af87de64930b0215d82f7d2647c, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:07.739923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fc60d-bdd1-4619-ab71-309a0c4d2c33 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:07.754512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 942/1879] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:07 2022] PUT /identity/v3/projects/bbdbdf3c58de41d681fc1faca2eb8132/users/7ff91af87de64930b0215d82f7d2647c/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:07.755314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fc60d-bdd1-4619-ab71-309a0c4d2c33 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:07.765238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c16fc60d-bdd1-4619-ab71-309a0c4d2c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:07.794175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd01ea265e9174e9b8628e77fe07bc1e7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:07.802599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd01ea265e9174e9b8628e77fe07bc1e7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:07.823002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd01ea265e9174e9b8628e77fe07bc1e7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:07.823733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd01ea265e9174e9b8628e77fe07bc1e7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:07.824347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd01ea265e9174e9b8628e77fe07bc1e7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:07.863915 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fc60d-bdd1-4619-ab71-309a0c4d2c33 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:07.870628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c0589-376a-49d5-89d7-f8e657528c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:07.871363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c0589-376a-49d5-89d7-f8e657528c8e service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:07.871795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c0589-376a-49d5-89d7-f8e657528c8e service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:07.872227 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c0589-376a-49d5-89d7-f8e657528c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:07.874353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c30c0589-376a-49d5-89d7-f8e657528c8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:07.888090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c0589-376a-49d5-89d7-f8e657528c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:07.889901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c0589-376a-49d5-89d7-f8e657528c8e service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:07.894772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 938/1880] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:07 2022] DELETE /identity/v3/users/d01ea265e9174e9b8628e77fe07bc1e7 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:07.895657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:07.896997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:07.911046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 943/1881] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:07.914335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96448618-3a6a-4399-95f6-4befd7bc2387 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:07.914335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96448618-3a6a-4399-95f6-4befd7bc2387 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:07.914335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96448618-3a6a-4399-95f6-4befd7bc2387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:07.924491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:07.957998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-96448618-3a6a-4399-95f6-4befd7bc2387 None None] MFA Rules not processed for user `7ff91af87de64930b0215d82f7d2647c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:07.959521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-96448618-3a6a-4399-95f6-4befd7bc2387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:08.034798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc43c1f-0f54-44fe-95e4-d8a5da470eaf admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:08.042791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc4428-d711-4ded-b157-0d1cb87803e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:08.043470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc4428-d711-4ded-b157-0d1cb87803e4 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:08.053239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc4428-d711-4ded-b157-0d1cb87803e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:08.053239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc4428-d711-4ded-b157-0d1cb87803e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:08.053239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc4428-d711-4ded-b157-0d1cb87803e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:08.053239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc4428-d711-4ded-b157-0d1cb87803e4 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:08.057421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 939/1882] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:08.058203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 944/1883] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:07 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:08.061732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc4428-d711-4ded-b157-0d1cb87803e4 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:08.071525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96448618-3a6a-4399-95f6-4befd7bc2387 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:08.072789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc4428-d711-4ded-b157-0d1cb87803e4 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:08.074182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-96448618-3a6a-4399-95f6-4befd7bc2387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:08.077967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba88eb-f3b9-4550-b7d7-7ff7b4a03fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:08.078664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba88eb-f3b9-4550-b7d7-7ff7b4a03fbc admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:08.079038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba88eb-f3b9-4550-b7d7-7ff7b4a03fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:08.079379 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba88eb-f3b9-4550-b7d7-7ff7b4a03fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:08.081003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba88eb-f3b9-4550-b7d7-7ff7b4a03fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:08.082851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba88eb-f3b9-4550-b7d7-7ff7b4a03fbc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:08.097196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 940/1884] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:08.105076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba88eb-f3b9-4550-b7d7-7ff7b4a03fbc admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:08.127327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba88eb-f3b9-4550-b7d7-7ff7b4a03fbc admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:08.145025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0fd8f-f754-48ec-bab1-52811f657831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:08.146012 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0fd8f-f754-48ec-bab1-52811f657831 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:08.146956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0fd8f-f754-48ec-bab1-52811f657831 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:08.147394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0fd8f-f754-48ec-bab1-52811f657831 admin admin] PATH_INFO: `/v3/projects/17db4a3366df4417b76b391ba98b0555/users/369007e0ebea48629887ebfd32e650ea/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:08.166680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96448618-3a6a-4399-95f6-4befd7bc2387 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:08.171573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da686620-25bd-4260-9b50-b4579c00cba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:08.172479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686620-25bd-4260-9b50-b4579c00cba1 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:08.172859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686620-25bd-4260-9b50-b4579c00cba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:08.173231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686620-25bd-4260-9b50-b4579c00cba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:08.185606 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da686620-25bd-4260-9b50-b4579c00cba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:08.187465 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da686620-25bd-4260-9b50-b4579c00cba1 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:08.193013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0fd8f-f754-48ec-bab1-52811f657831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17db4a3366df4417b76b391ba98b0555, user_id=369007e0ebea48629887ebfd32e650ea, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:08.197099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0fd8f-f754-48ec-bab1-52811f657831 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:08.202878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 945/1885] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:08 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:08.330065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 941/1886] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:08 2022] PUT /identity/v3/projects/17db4a3366df4417b76b391ba98b0555/users/369007e0ebea48629887ebfd32e650ea/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:08.335332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baeaa9-751c-49ac-b1ee-f7d726801dce None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:08.336468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baeaa9-751c-49ac-b1ee-f7d726801dce None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:08.336468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baeaa9-751c-49ac-b1ee-f7d726801dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:08.379920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f9baeaa9-751c-49ac-b1ee-f7d726801dce None None] MFA Rules not processed for user `369007e0ebea48629887ebfd32e650ea`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:08.381742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f9baeaa9-751c-49ac-b1ee-f7d726801dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:08.413728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0fd8f-f754-48ec-bab1-52811f657831 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:08.471200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:08.485188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 946/1887] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:08.487340 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baeaa9-751c-49ac-b1ee-f7d726801dce None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:08.488673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f9baeaa9-751c-49ac-b1ee-f7d726801dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:08.568240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0fd8f-f754-48ec-bab1-52811f657831 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:08.570109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc300e-1773-42ca-8b24-17e1cfb14519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:08.571907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc300e-1773-42ca-8b24-17e1cfb14519 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:08.573576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc300e-1773-42ca-8b24-17e1cfb14519 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:08.574143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc300e-1773-42ca-8b24-17e1cfb14519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:08.579561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bfcc300e-1773-42ca-8b24-17e1cfb14519 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:08.656599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9baeaa9-751c-49ac-b1ee-f7d726801dce None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:08.668907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:08.669588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:08.669868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:08.670138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] PATH_INFO: `/v3/projects/1924679427644c8484613f703518badc` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:08.672833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1924679427644c8484613f703518badc)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:08.679123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:08.739050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc300e-1773-42ca-8b24-17e1cfb14519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:08.740702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc300e-1773-42ca-8b24-17e1cfb14519 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:08.763164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 942/1888] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:08 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:01:08.765301 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc300e-1773-42ca-8b24-17e1cfb14519 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:08.791914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc300e-1773-42ca-8b24-17e1cfb14519 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:08.802753 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ff1f9-5322-4cb5-9174-6fa3b937e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:08.807601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ff1f9-5322-4cb5-9174-6fa3b937e9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:08.808256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ff1f9-5322-4cb5-9174-6fa3b937e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:08.808732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ff1f9-5322-4cb5-9174-6fa3b937e9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:08.809596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ff1f9-5322-4cb5-9174-6fa3b937e9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:08.815021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ff1f9-5322-4cb5-9174-6fa3b937e9f1 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:08.885703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1924679427644c8484613f703518badc', 'request_id': 'req-20263b2d-15f0-402f-81aa-23b0d2222d11'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:08.904906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1924679427644c8484613f703518badc', 'request_id': 'req-20263b2d-15f0-402f-81aa-23b0d2222d11'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:08.937441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 943/1889] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:08 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:08.941419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ff1f9-5322-4cb5-9174-6fa3b937e9f1 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.049841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1924679427644c8484613f703518badc', 'request_id': 'req-20263b2d-15f0-402f-81aa-23b0d2222d11'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:09.060753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] The token cache is being invalidate because project 1924679427644c8484613f703518badc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:09.061265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:09.065110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-20263b2d-15f0-402f-81aa-23b0d2222d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:09.065110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 947/1890] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:08 2022] DELETE /identity/v3/projects/1924679427644c8484613f703518badc => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:09.069381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d46d-79ec-415f-8135-fc2585f565ef None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.071893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d46d-79ec-415f-8135-fc2585f565ef None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.071893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041d46d-79ec-415f-8135-fc2585f565ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.096751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ff1f9-5322-4cb5-9174-6fa3b937e9f1 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.108338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1552dcd-0bec-42ab-ab11-860364258cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.109139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1552dcd-0bec-42ab-ab11-860364258cfe admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.109563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1552dcd-0bec-42ab-ab11-860364258cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.109776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1552dcd-0bec-42ab-ab11-860364258cfe admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.110416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1552dcd-0bec-42ab-ab11-860364258cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.115100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1552dcd-0bec-42ab-ab11-860364258cfe admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:09.144650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9041d46d-79ec-415f-8135-fc2585f565ef None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:09.146190 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9041d46d-79ec-415f-8135-fc2585f565ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:09.184092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 948/1891] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:09.185912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639cf48-9e7a-4f84-9143-3cb8fe489a20 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.187037 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639cf48-9e7a-4f84-9143-3cb8fe489a20 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.187419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639cf48-9e7a-4f84-9143-3cb8fe489a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.224442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a639cf48-9e7a-4f84-9143-3cb8fe489a20 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:09.225822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a639cf48-9e7a-4f84-9143-3cb8fe489a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:09.239503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 949/1892] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:09.241115 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639cf48-9e7a-4f84-9143-3cb8fe489a20 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.253723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639cf48-9e7a-4f84-9143-3cb8fe489a20 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.263824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 944/1893] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:08 2022] POST /identity/v3/users => generated 289 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:09.270946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1552dcd-0bec-42ab-ab11-860364258cfe admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.271605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61825a-61c6-4078-8900-efdea72afc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.272244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61825a-61c6-4078-8900-efdea72afc14 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.272588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61825a-61c6-4078-8900-efdea72afc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.272799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61825a-61c6-4078-8900-efdea72afc14 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.273498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61825a-61c6-4078-8900-efdea72afc14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:09.273805 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61825a-61c6-4078-8900-efdea72afc14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.274114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e1552dcd-0bec-42ab-ab11-860364258cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:09.275609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61825a-61c6-4078-8900-efdea72afc14 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:09.288359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1552dcd-0bec-42ab-ab11-860364258cfe admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.296669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e938b-c808-430e-b7e2-2b277fe2e077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.296669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e938b-c808-430e-b7e2-2b277fe2e077 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.296669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e938b-c808-430e-b7e2-2b277fe2e077 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.296669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e938b-c808-430e-b7e2-2b277fe2e077 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.297271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e938b-c808-430e-b7e2-2b277fe2e077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.297739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e938b-c808-430e-b7e2-2b277fe2e077 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:09.304710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 950/1894] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:09.306572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61825a-61c6-4078-8900-efdea72afc14 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.316235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 945/1895] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:09.320103 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61825a-61c6-4078-8900-efdea72afc14 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.322270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e938b-c808-430e-b7e2-2b277fe2e077 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.325611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689e91d-6f68-4487-900e-352360f05014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.326259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689e91d-6f68-4487-900e-352360f05014 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.326632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689e91d-6f68-4487-900e-352360f05014 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.326911 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689e91d-6f68-4487-900e-352360f05014 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.327704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689e91d-6f68-4487-900e-352360f05014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.330974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689e91d-6f68-4487-900e-352360f05014 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:09.336561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e938b-c808-430e-b7e2-2b277fe2e077 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.342724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55513c5a-1502-4f2f-976a-7a6b432e3b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.343838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55513c5a-1502-4f2f-976a-7a6b432e3b85 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.344258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55513c5a-1502-4f2f-976a-7a6b432e3b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.344771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55513c5a-1502-4f2f-976a-7a6b432e3b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.345624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55513c5a-1502-4f2f-976a-7a6b432e3b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.347495 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55513c5a-1502-4f2f-976a-7a6b432e3b85 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:09.365604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 946/1896] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:09.367373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55513c5a-1502-4f2f-976a-7a6b432e3b85 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.381085 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55513c5a-1502-4f2f-976a-7a6b432e3b85 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.388009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd578b8c-73ba-4407-b379-80c1cbeb9c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.389028 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd578b8c-73ba-4407-b379-80c1cbeb9c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.389498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd578b8c-73ba-4407-b379-80c1cbeb9c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.389956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd578b8c-73ba-4407-b379-80c1cbeb9c0b admin admin] PATH_INFO: `/v3/projects/d1ddb1ad267845519e23f48f3dc40e13/users/b79cf790a52b4319b2e5eeff1ecc7447/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.410289 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd578b8c-73ba-4407-b379-80c1cbeb9c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ddb1ad267845519e23f48f3dc40e13, user_id=b79cf790a52b4319b2e5eeff1ecc7447, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.412970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd578b8c-73ba-4407-b379-80c1cbeb9c0b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:09.501371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 951/1897] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:09 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:09.510589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689e91d-6f68-4487-900e-352360f05014 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.533759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 947/1898] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:09 2022] PUT /identity/v3/projects/d1ddb1ad267845519e23f48f3dc40e13/users/b79cf790a52b4319b2e5eeff1ecc7447/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:09.535329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53828ff-26c5-463a-9d42-92a337da2f40 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.535623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53828ff-26c5-463a-9d42-92a337da2f40 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.535900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53828ff-26c5-463a-9d42-92a337da2f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.574237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f53828ff-26c5-463a-9d42-92a337da2f40 None None] MFA Rules not processed for user `b79cf790a52b4319b2e5eeff1ecc7447`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:09.575464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f53828ff-26c5-463a-9d42-92a337da2f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:09.603095 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689e91d-6f68-4487-900e-352360f05014 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.670920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 948/1899] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:09.673135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53828ff-26c5-463a-9d42-92a337da2f40 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.699585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f4b00-52ee-415d-a654-b1c58e3692c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.700330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f4b00-52ee-415d-a654-b1c58e3692c0 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.700708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f4b00-52ee-415d-a654-b1c58e3692c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.701523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f4b00-52ee-415d-a654-b1c58e3692c0 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.701844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f4b00-52ee-415d-a654-b1c58e3692c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.703998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f4b00-52ee-415d-a654-b1c58e3692c0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:09.779436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53828ff-26c5-463a-9d42-92a337da2f40 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.784642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf968c44-5d00-42fa-aa41-1301d207903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.785398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf968c44-5d00-42fa-aa41-1301d207903f admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.785752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf968c44-5d00-42fa-aa41-1301d207903f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.786455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf968c44-5d00-42fa-aa41-1301d207903f admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.786926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf968c44-5d00-42fa-aa41-1301d207903f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.789062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf968c44-5d00-42fa-aa41-1301d207903f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:09.825530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 952/1900] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:09 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:09.828895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f4b00-52ee-415d-a654-b1c58e3692c0 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.841883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f4b00-52ee-415d-a654-b1c58e3692c0 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.847040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af153c94-5926-4ccb-a564-4c80e99ca778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.847804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af153c94-5926-4ccb-a564-4c80e99ca778 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.848187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af153c94-5926-4ccb-a564-4c80e99ca778 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.848551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af153c94-5926-4ccb-a564-4c80e99ca778 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.849330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af153c94-5926-4ccb-a564-4c80e99ca778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.851048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af153c94-5926-4ccb-a564-4c80e99ca778 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:09.863717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 953/1901] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:09.867836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af153c94-5926-4ccb-a564-4c80e99ca778 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.879199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af153c94-5926-4ccb-a564-4c80e99ca778 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.884248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08975ee8-79be-4caa-8edb-91c1500f5f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.884873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08975ee8-79be-4caa-8edb-91c1500f5f1e admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.885153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08975ee8-79be-4caa-8edb-91c1500f5f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.885463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08975ee8-79be-4caa-8edb-91c1500f5f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.886112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08975ee8-79be-4caa-8edb-91c1500f5f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.887720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08975ee8-79be-4caa-8edb-91c1500f5f1e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:09.902084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 954/1902] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:09.903212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08975ee8-79be-4caa-8edb-91c1500f5f1e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:09.913325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08975ee8-79be-4caa-8edb-91c1500f5f1e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:09.918160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951edd5b-101e-45d5-83e5-a740387e29d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:09.918838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951edd5b-101e-45d5-83e5-a740387e29d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:09.919119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951edd5b-101e-45d5-83e5-a740387e29d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:09.919393 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951edd5b-101e-45d5-83e5-a740387e29d5 admin admin] PATH_INFO: `/v3/projects/1847704e083a496abfed6029e86f4724/users/ab6caa33fe9243b88760f092f5e411fa/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:09.939555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951edd5b-101e-45d5-83e5-a740387e29d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1847704e083a496abfed6029e86f4724, user_id=ab6caa33fe9243b88760f092f5e411fa, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:09.942855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951edd5b-101e-45d5-83e5-a740387e29d5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:10.127387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 955/1903] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:09 2022] PUT /identity/v3/projects/1847704e083a496abfed6029e86f4724/users/ab6caa33fe9243b88760f092f5e411fa/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:10.131543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6ccc2-4bf6-476c-81c7-aa0af7ff45ae None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:10.132067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6ccc2-4bf6-476c-81c7-aa0af7ff45ae None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:10.132724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6ccc2-4bf6-476c-81c7-aa0af7ff45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:10.133019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 949/1904] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:09 2022] POST /identity/v3/projects => generated 373 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:10.134967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf968c44-5d00-42fa-aa41-1301d207903f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:10.172950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f7c6ccc2-4bf6-476c-81c7-aa0af7ff45ae None None] MFA Rules not processed for user `ab6caa33fe9243b88760f092f5e411fa`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:10.174950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f7c6ccc2-4bf6-476c-81c7-aa0af7ff45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:10.241959 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf968c44-5d00-42fa-aa41-1301d207903f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:10.254803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd307ca7-fdcc-4c75-bb10-8ab0cd0e8321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:10.259392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307ca7-fdcc-4c75-bb10-8ab0cd0e8321 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:10.259392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307ca7-fdcc-4c75-bb10-8ab0cd0e8321 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:10.259392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307ca7-fdcc-4c75-bb10-8ab0cd0e8321 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:10.259392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd307ca7-fdcc-4c75-bb10-8ab0cd0e8321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:10.260938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd307ca7-fdcc-4c75-bb10-8ab0cd0e8321 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:10.288436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 956/1905] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:10.300622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6ccc2-4bf6-476c-81c7-aa0af7ff45ae None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:10.313751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6ccc2-4bf6-476c-81c7-aa0af7ff45ae None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:10.319190 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b929a3b-90f3-4ddb-8cfa-a6db524c4a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:10.320151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b929a3b-90f3-4ddb-8cfa-a6db524c4a4d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:10.320566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b929a3b-90f3-4ddb-8cfa-a6db524c4a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:10.320841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b929a3b-90f3-4ddb-8cfa-a6db524c4a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:10.321510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b929a3b-90f3-4ddb-8cfa-a6db524c4a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:10.323924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b929a3b-90f3-4ddb-8cfa-a6db524c4a4d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:10.363374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 950/1906] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:10 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:10.367355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd307ca7-fdcc-4c75-bb10-8ab0cd0e8321 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:10.396332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd307ca7-fdcc-4c75-bb10-8ab0cd0e8321 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:10.413786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ebfc4-31ca-4af0-a061-cb5e95bc7555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:10.414420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ebfc4-31ca-4af0-a061-cb5e95bc7555 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:10.414706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ebfc4-31ca-4af0-a061-cb5e95bc7555 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:10.415013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ebfc4-31ca-4af0-a061-cb5e95bc7555 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:10.415597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ebfc4-31ca-4af0-a061-cb5e95bc7555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:10.417192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ebfc4-31ca-4af0-a061-cb5e95bc7555 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:10.436494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 951/1907] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:10.437673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ebfc4-31ca-4af0-a061-cb5e95bc7555 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:10.458261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ebfc4-31ca-4af0-a061-cb5e95bc7555 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:10.464606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018df89-6848-42fc-bde3-130e13e8825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:10.465496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018df89-6848-42fc-bde3-130e13e8825b admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:10.465767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018df89-6848-42fc-bde3-130e13e8825b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:10.466041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018df89-6848-42fc-bde3-130e13e8825b admin admin] PATH_INFO: `/v3/projects/8ca5aaba03d9480192f4c16d22330ce3/users/2df998fee6ad4217b495613711b6dfcd/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:10.484273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 957/1908] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:10 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:10.488632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b929a3b-90f3-4ddb-8cfa-a6db524c4a4d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:10.500138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018df89-6848-42fc-bde3-130e13e8825b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca5aaba03d9480192f4c16d22330ce3, user_id=2df998fee6ad4217b495613711b6dfcd, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:10.503186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018df89-6848-42fc-bde3-130e13e8825b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:10.557974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:10.594084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 952/1909] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:10 2022] PUT /identity/v3/projects/8ca5aaba03d9480192f4c16d22330ce3/users/2df998fee6ad4217b495613711b6dfcd/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:10.596247 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018df89-6848-42fc-bde3-130e13e8825b admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:10.609934 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b929a3b-90f3-4ddb-8cfa-a6db524c4a4d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:10.711052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018df89-6848-42fc-bde3-130e13e8825b admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:10.719947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeff5a-093a-4c58-82a2-cf400593466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:10.721256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeff5a-093a-4c58-82a2-cf400593466b admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:10.721636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeff5a-093a-4c58-82a2-cf400593466b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:10.721977 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eeff5a-093a-4c58-82a2-cf400593466b admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:10.723493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeff5a-093a-4c58-82a2-cf400593466b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:10.726477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eeff5a-093a-4c58-82a2-cf400593466b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:10.743730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499011b-24d6-4c06-8d59-b086e4b4513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:10.744359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499011b-24d6-4c06-8d59-b086e4b4513f admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:10.745446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499011b-24d6-4c06-8d59-b086e4b4513f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:10.745446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499011b-24d6-4c06-8d59-b086e4b4513f admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:10.745793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499011b-24d6-4c06-8d59-b086e4b4513f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:10.748464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499011b-24d6-4c06-8d59-b086e4b4513f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:10.749363 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 953/1910] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:10.753447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeff5a-093a-4c58-82a2-cf400593466b admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:10.780828 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eeff5a-093a-4c58-82a2-cf400593466b admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:10.787106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fdb8b-88d2-4e71-8b4c-7531a0c9f672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:10.788355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fdb8b-88d2-4e71-8b4c-7531a0c9f672 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:10.789007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fdb8b-88d2-4e71-8b4c-7531a0c9f672 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:10.789512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fdb8b-88d2-4e71-8b4c-7531a0c9f672 admin admin] PATH_INFO: `/v3/projects/8ca5aaba03d9480192f4c16d22330ce3/users/2df998fee6ad4217b495613711b6dfcd/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:10.792357 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fdb8b-88d2-4e71-8b4c-7531a0c9f672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca5aaba03d9480192f4c16d22330ce3, user_id=2df998fee6ad4217b495613711b6dfcd, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:10.795296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fdb8b-88d2-4e71-8b4c-7531a0c9f672 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:10.808804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 954/1911] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:10 2022] PUT /identity/v3/projects/8ca5aaba03d9480192f4c16d22330ce3/users/2df998fee6ad4217b495613711b6dfcd/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:10.823655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249319a4-3279-4321-ba26-68f88d4bd6a4 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:10.823940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249319a4-3279-4321-ba26-68f88d4bd6a4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:10.824212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249319a4-3279-4321-ba26-68f88d4bd6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:10.865778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 958/1912] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:10 2022] POST /identity/v3/users => generated 300 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:10.867897 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-249319a4-3279-4321-ba26-68f88d4bd6a4 None None] MFA Rules not processed for user `2df998fee6ad4217b495613711b6dfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:10.872397 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-249319a4-3279-4321-ba26-68f88d4bd6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:10.875262 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499011b-24d6-4c06-8d59-b086e4b4513f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:10.900487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499011b-24d6-4c06-8d59-b086e4b4513f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:11.027100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 955/1913] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:11.029579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9050f-7ded-4161-80ef-6c4d5780574f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:11.030420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9050f-7ded-4161-80ef-6c4d5780574f admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:11.030881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9050f-7ded-4161-80ef-6c4d5780574f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:11.031379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9050f-7ded-4161-80ef-6c4d5780574f admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:11.032210 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9050f-7ded-4161-80ef-6c4d5780574f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:11.034973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9050f-7ded-4161-80ef-6c4d5780574f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:11.035691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249319a4-3279-4321-ba26-68f88d4bd6a4 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:11.042213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-249319a4-3279-4321-ba26-68f88d4bd6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:11.046237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 959/1914] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:11.050458 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9050f-7ded-4161-80ef-6c4d5780574f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:11.066482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9050f-7ded-4161-80ef-6c4d5780574f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:11.071669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bd247-4647-4de4-a6d0-07d1793836a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:11.072508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bd247-4647-4de4-a6d0-07d1793836a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:11.072781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bd247-4647-4de4-a6d0-07d1793836a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:11.073054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bd247-4647-4de4-a6d0-07d1793836a7 admin admin] PATH_INFO: `/v3/projects/f3d8bcd6f8b7459bab219404346eebfe/users/0bf1cf4e916d49a18733927f02e900b2/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:11.100055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bd247-4647-4de4-a6d0-07d1793836a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d8bcd6f8b7459bab219404346eebfe, user_id=0bf1cf4e916d49a18733927f02e900b2, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:11.102987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bd247-4647-4de4-a6d0-07d1793836a7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:11.125765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249319a4-3279-4321-ba26-68f88d4bd6a4 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:11.129965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f9e40-da3d-48c6-a259-b2d316202275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:11.131617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f9e40-da3d-48c6-a259-b2d316202275 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:11.131617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f9e40-da3d-48c6-a259-b2d316202275 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:11.131617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f9e40-da3d-48c6-a259-b2d316202275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:11.133122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ee8f9e40-da3d-48c6-a259-b2d316202275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:11.193239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f9e40-da3d-48c6-a259-b2d316202275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:11.194901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f9e40-da3d-48c6-a259-b2d316202275 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:11.203798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 956/1915] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:11.231744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 960/1916] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:11 2022] PUT /identity/v3/projects/f3d8bcd6f8b7459bab219404346eebfe/users/0bf1cf4e916d49a18733927f02e900b2/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:11.236704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f9e40-da3d-48c6-a259-b2d316202275 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:11.248518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f9e40-da3d-48c6-a259-b2d316202275 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:11.328639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c5a2a-957a-4925-a3ea-3a6569cee490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:11.330661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c5a2a-957a-4925-a3ea-3a6569cee490 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:11.331295 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c5a2a-957a-4925-a3ea-3a6569cee490 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:11.331661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c5a2a-957a-4925-a3ea-3a6569cee490 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:11.332780 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c5a2a-957a-4925-a3ea-3a6569cee490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:11.334542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c5a2a-957a-4925-a3ea-3a6569cee490 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:11.352629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 957/1917] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:11.354122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bd247-4647-4de4-a6d0-07d1793836a7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:11.365197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bd247-4647-4de4-a6d0-07d1793836a7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:11.369927 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faf2f5-8cb1-4c34-af2a-db9df2931060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:11.370579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf2f5-8cb1-4c34-af2a-db9df2931060 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:11.372058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf2f5-8cb1-4c34-af2a-db9df2931060 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:11.372058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faf2f5-8cb1-4c34-af2a-db9df2931060 admin admin] PATH_INFO: `/v3/projects/f3d8bcd6f8b7459bab219404346eebfe/users/0bf1cf4e916d49a18733927f02e900b2/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:11.373076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2faf2f5-8cb1-4c34-af2a-db9df2931060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d8bcd6f8b7459bab219404346eebfe, user_id=0bf1cf4e916d49a18733927f02e900b2, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:11.375898 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2faf2f5-8cb1-4c34-af2a-db9df2931060 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:11.388171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 961/1918] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:11 2022] PUT /identity/v3/projects/f3d8bcd6f8b7459bab219404346eebfe/users/0bf1cf4e916d49a18733927f02e900b2/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:11.399275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885257c-f172-4297-bca3-7ed4cdce1f6a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:11.399623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885257c-f172-4297-bca3-7ed4cdce1f6a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:11.399897 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885257c-f172-4297-bca3-7ed4cdce1f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:11.430702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7885257c-f172-4297-bca3-7ed4cdce1f6a None None] MFA Rules not processed for user `0bf1cf4e916d49a18733927f02e900b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:11.431904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7885257c-f172-4297-bca3-7ed4cdce1f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:11.534243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 958/1919] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:11.643417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faf2f5-8cb1-4c34-af2a-db9df2931060 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:11.645639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d2faf2f5-8cb1-4c34-af2a-db9df2931060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:11.718165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faf2f5-8cb1-4c34-af2a-db9df2931060 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:11.722295 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8dfe7-4833-423d-960c-7f732bfe51a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:11.722890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8dfe7-4833-423d-960c-7f732bfe51a8 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:11.723184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8dfe7-4833-423d-960c-7f732bfe51a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:11.723437 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8dfe7-4833-423d-960c-7f732bfe51a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:11.732409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8dfe7-4833-423d-960c-7f732bfe51a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:11.733954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8dfe7-4833-423d-960c-7f732bfe51a8 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:11.744116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 962/1920] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:11.772739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885257c-f172-4297-bca3-7ed4cdce1f6a None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:11.839941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885257c-f172-4297-bca3-7ed4cdce1f6a None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:11.844771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:11.847182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:11.847182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:11.847182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] PATH_INFO: `/v3/users/ab6caa33fe9243b88760f092f5e411fa` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:11.847657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6caa33fe9243b88760f092f5e411fa)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:11.849658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:12.089137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6caa33fe9243b88760f092f5e411fa'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:12.100391 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6caa33fe9243b88760f092f5e411fa'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:12.113374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:12.128086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6caa33fe9243b88760f092f5e411fa'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:12.130767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6caa33fe9243b88760f092f5e411fa'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:12.130767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6caa33fe9243b88760f092f5e411fa'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:12.227536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 959/1921] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:11 2022] DELETE /identity/v3/users/ab6caa33fe9243b88760f092f5e411fa => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:12.232937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b1c6-2306-4212-a115-106aeac8aa58 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:12.233229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b1c6-2306-4212-a115-106aeac8aa58 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:12.233536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b1c6-2306-4212-a115-106aeac8aa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:12.257672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9e07b1c6-2306-4212-a115-106aeac8aa58 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:12.259039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9e07b1c6-2306-4212-a115-106aeac8aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:12.325749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 963/1922] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:12.335268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:12.338065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:12.415031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238f46c-5823-431e-b345-b31def0a5bb8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:12.424035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7179d5-2cf4-4f48-8ecf-eabd69564094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:12.424035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7179d5-2cf4-4f48-8ecf-eabd69564094 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:12.424035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7179d5-2cf4-4f48-8ecf-eabd69564094 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:12.424035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7179d5-2cf4-4f48-8ecf-eabd69564094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:12.435120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7179d5-2cf4-4f48-8ecf-eabd69564094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:12.436619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7179d5-2cf4-4f48-8ecf-eabd69564094 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:12.447917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 960/1923] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:13.335068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07b1c6-2306-4212-a115-106aeac8aa58 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:13.336998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9e07b1c6-2306-4212-a115-106aeac8aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:13.392701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7179d5-2cf4-4f48-8ecf-eabd69564094 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:13.394187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-cf7179d5-2cf4-4f48-8ecf-eabd69564094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:13.410282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7179d5-2cf4-4f48-8ecf-eabd69564094 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:13.410556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07b1c6-2306-4212-a115-106aeac8aa58 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:13.415022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a18d2-6c97-44df-95cf-165ad247167e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:13.415736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a18d2-6c97-44df-95cf-165ad247167e service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:13.416010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a18d2-6c97-44df-95cf-165ad247167e service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:13.416331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a18d2-6c97-44df-95cf-165ad247167e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:13.416796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:13.417701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:13.418074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:13.418483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] PATH_INFO: `/v3/projects/1847704e083a496abfed6029e86f4724` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:13.418608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e61a18d2-6c97-44df-95cf-165ad247167e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:13.420406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1847704e083a496abfed6029e86f4724)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:13.422962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:13.495904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a18d2-6c97-44df-95cf-165ad247167e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:13.499928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a18d2-6c97-44df-95cf-165ad247167e service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:13.514105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 964/1924] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:13.529834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1847704e083a496abfed6029e86f4724', 'request_id': 'req-f1cc3922-ff1f-42f1-812d-d4d1c968c832'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.537949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1847704e083a496abfed6029e86f4724', 'request_id': 'req-f1cc3922-ff1f-42f1-812d-d4d1c968c832'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.590748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1847704e083a496abfed6029e86f4724', 'request_id': 'req-f1cc3922-ff1f-42f1-812d-d4d1c968c832'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.612999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] The token cache is being invalidate because project 1847704e083a496abfed6029e86f4724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:13.613327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.614288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.619270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a18d2-6c97-44df-95cf-165ad247167e service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:13.620035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 961/1925] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:13 2022] DELETE /identity/v3/projects/1847704e083a496abfed6029e86f4724 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:13.621031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e61a18d2-6c97-44df-95cf-165ad247167e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:13.627601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:13.634299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:13.640678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a18d2-6c97-44df-95cf-165ad247167e service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:13.707061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:13.710575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3922-ff1f-42f1-812d-d4d1c968c832 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:13.710867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:13.710867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:13.710867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:13.710867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] PATH_INFO: `/v3/users/3562bc0e4c3242e9ba8c27499c72e37e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:13.711618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3562bc0e4c3242e9ba8c27499c72e37e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:13.721330 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:13.721496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:13.721612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:13.721612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:13.721612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] PATH_INFO: `/v3/users/0bf1cf4e916d49a18733927f02e900b2` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:13.721612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf1cf4e916d49a18733927f02e900b2)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:13.721612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:13.923918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3562bc0e4c3242e9ba8c27499c72e37e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.937893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3562bc0e4c3242e9ba8c27499c72e37e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.938898 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3562bc0e4c3242e9ba8c27499c72e37e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.940168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3562bc0e4c3242e9ba8c27499c72e37e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.952834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf1cf4e916d49a18733927f02e900b2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.960999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf1cf4e916d49a18733927f02e900b2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.973512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf1cf4e916d49a18733927f02e900b2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.974235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf1cf4e916d49a18733927f02e900b2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:13.974836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf1cf4e916d49a18733927f02e900b2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:14.036269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-51920e75-3043-480c-a1bf-f75351704c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3562bc0e4c3242e9ba8c27499c72e37e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:14.049455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 965/1926] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:13 2022] DELETE /identity/v3/users/3562bc0e4c3242e9ba8c27499c72e37e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:14.053713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba49f4-963f-4b45-9a96-0133dfdb2580 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:14.054001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba49f4-963f-4b45-9a96-0133dfdb2580 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:14.054281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba49f4-963f-4b45-9a96-0133dfdb2580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:14.072841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2aba49f4-963f-4b45-9a96-0133dfdb2580 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:14.074069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2aba49f4-963f-4b45-9a96-0133dfdb2580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:14.123724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 962/1927] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:13 2022] DELETE /identity/v3/users/0bf1cf4e916d49a18733927f02e900b2 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:14.135303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 966/1928] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:14.146530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:14.149788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:14.214063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9e154-c200-42c7-97f0-f66a4905c2d1 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:14.218074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2ad3d-3557-4e42-821c-50b9820b3ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:14.218868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2ad3d-3557-4e42-821c-50b9820b3ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:14.219344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2ad3d-3557-4e42-821c-50b9820b3ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:14.219685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2ad3d-3557-4e42-821c-50b9820b3ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:14.295467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2ad3d-3557-4e42-821c-50b9820b3ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:14.298829 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2ad3d-3557-4e42-821c-50b9820b3ba6 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:14.308565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 963/1929] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:14.525626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:14.632870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba49f4-963f-4b45-9a96-0133dfdb2580 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:14.635270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2aba49f4-963f-4b45-9a96-0133dfdb2580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:14.647558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba49f4-963f-4b45-9a96-0133dfdb2580 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:14.652406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:14.652932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:14.653208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:14.653510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] PATH_INFO: `/v3/projects/f3d8bcd6f8b7459bab219404346eebfe` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:14.654880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d8bcd6f8b7459bab219404346eebfe)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:14.656956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:14.802863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d8bcd6f8b7459bab219404346eebfe', 'request_id': 'req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:14.809129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d8bcd6f8b7459bab219404346eebfe', 'request_id': 'req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:14.829109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2ad3d-3557-4e42-821c-50b9820b3ba6 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:14.831908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c4b2ad3d-3557-4e42-821c-50b9820b3ba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:14.849872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2ad3d-3557-4e42-821c-50b9820b3ba6 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:14.914182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:14.914819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:14.915097 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:14.915409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] PATH_INFO: `/v3/projects/cf6884a4864c4b59a47f3011de8f41a0` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:14.916552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6884a4864c4b59a47f3011de8f41a0)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:14.918474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:15.002280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:15.004625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d8bcd6f8b7459bab219404346eebfe', 'request_id': 'req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.020224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] The token cache is being invalidate because project f3d8bcd6f8b7459bab219404346eebfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:15.020582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.021223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a77dc65-b836-4a39-b00a-4fa9ba8f6581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.021363 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6884a4864c4b59a47f3011de8f41a0', 'request_id': 'req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.024039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 967/1930] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:14 2022] DELETE /identity/v3/projects/f3d8bcd6f8b7459bab219404346eebfe => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:15.031472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6884a4864c4b59a47f3011de8f41a0', 'request_id': 'req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.045739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d4d83-6aab-4e31-b620-539fce5e0532 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.046079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d4d83-6aab-4e31-b620-539fce5e0532 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.046353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d4d83-6aab-4e31-b620-539fce5e0532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.074604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-951d4d83-6aab-4e31-b620-539fce5e0532 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:15.075815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-951d4d83-6aab-4e31-b620-539fce5e0532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:15.111006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6884a4864c4b59a47f3011de8f41a0', 'request_id': 'req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.131441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] The token cache is being invalidate because project cf6884a4864c4b59a47f3011de8f41a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:15.132106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.133072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.134908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 964/1931] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:14 2022] DELETE /identity/v3/projects/cf6884a4864c4b59a47f3011de8f41a0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:15.138947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:15.140595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:15.145180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 968/1932] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:15.156154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce188e-7d66-4513-97dd-ce2fb829b710 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.156972 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce188e-7d66-4513-97dd-ce2fb829b710 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.158035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce188e-7d66-4513-97dd-ce2fb829b710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.159590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e85ce-f5cf-4d4d-9181-2b66aa971189 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:15.165173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:15.165850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.166177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.166448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] PATH_INFO: `/v3/users/7ff91af87de64930b0215d82f7d2647c` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.167571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff91af87de64930b0215d82f7d2647c)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:15.169940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:15.185047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5bce188e-7d66-4513-97dd-ce2fb829b710 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:15.187162 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5bce188e-7d66-4513-97dd-ce2fb829b710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:15.209339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 969/1933] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:15.211533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce188e-7d66-4513-97dd-ce2fb829b710 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:15.224092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce188e-7d66-4513-97dd-ce2fb829b710 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:15.231420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d3318-7036-45ae-9182-958c1534964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:15.231420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d3318-7036-45ae-9182-958c1534964b admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.231420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d3318-7036-45ae-9182-958c1534964b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.231420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d3318-7036-45ae-9182-958c1534964b admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.231861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d3318-7036-45ae-9182-958c1534964b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:15.232147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d3318-7036-45ae-9182-958c1534964b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:15.234058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d3318-7036-45ae-9182-958c1534964b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:15.249521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 970/1934] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:15.249521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d3318-7036-45ae-9182-958c1534964b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:15.249521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-513d3318-7036-45ae-9182-958c1534964b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:15.306595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d3318-7036-45ae-9182-958c1534964b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:15.310157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e053b4a-ec18-40a9-8d09-8c9dd816954c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:15.310747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e053b4a-ec18-40a9-8d09-8c9dd816954c service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.311021 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e053b4a-ec18-40a9-8d09-8c9dd816954c service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.311288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e053b4a-ec18-40a9-8d09-8c9dd816954c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.312974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9e053b4a-ec18-40a9-8d09-8c9dd816954c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:15.360896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff91af87de64930b0215d82f7d2647c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.369110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff91af87de64930b0215d82f7d2647c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.377718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e053b4a-ec18-40a9-8d09-8c9dd816954c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:15.380708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e053b4a-ec18-40a9-8d09-8c9dd816954c service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:15.387717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff91af87de64930b0215d82f7d2647c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.388473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff91af87de64930b0215d82f7d2647c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.389088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff91af87de64930b0215d82f7d2647c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.390708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 971/1935] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:15.391511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e053b4a-ec18-40a9-8d09-8c9dd816954c service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:15.402451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e053b4a-ec18-40a9-8d09-8c9dd816954c service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:15.407648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2e67f-6db1-4ad9-a851-6d777c5f966c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:15.408420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2e67f-6db1-4ad9-a851-6d777c5f966c admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.413164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2e67f-6db1-4ad9-a851-6d777c5f966c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.413164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2e67f-6db1-4ad9-a851-6d777c5f966c admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.413164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2e67f-6db1-4ad9-a851-6d777c5f966c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:15.413164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2e67f-6db1-4ad9-a851-6d777c5f966c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:15.443160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:15.471045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 965/1936] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:15 2022] DELETE /identity/v3/users/7ff91af87de64930b0215d82f7d2647c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:15.471045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:15.471045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:15.489736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 972/1937] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:15 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:15.496762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2e67f-6db1-4ad9-a851-6d777c5f966c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:15.498590 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-61e2e67f-6db1-4ad9-a851-6d777c5f966c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:15.560314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168adee-3423-49fe-bee5-cb89d9349daa admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:15.610065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2e67f-6db1-4ad9-a851-6d777c5f966c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:15.621461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dca04-7482-4e4b-abc7-5f6ae44e7fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:15.622878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dca04-7482-4e4b-abc7-5f6ae44e7fcc admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.624703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dca04-7482-4e4b-abc7-5f6ae44e7fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.624703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dca04-7482-4e4b-abc7-5f6ae44e7fcc admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.624703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dca04-7482-4e4b-abc7-5f6ae44e7fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:15.628278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dca04-7482-4e4b-abc7-5f6ae44e7fcc admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:15.635622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:15.636287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.636561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.636827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] PATH_INFO: `/v3/users/bcd6bb97e185474d98d551947f07d0be` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.638204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd6bb97e185474d98d551947f07d0be)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:15.641681 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:15.727612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 973/1938] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:15 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:15.733597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dca04-7482-4e4b-abc7-5f6ae44e7fcc admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:15.750631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dca04-7482-4e4b-abc7-5f6ae44e7fcc admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:15.755312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4f59b-11b4-4822-95bb-94c398053b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:15.755927 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4f59b-11b4-4822-95bb-94c398053b62 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.756199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4f59b-11b4-4822-95bb-94c398053b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.756466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4f59b-11b4-4822-95bb-94c398053b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.757365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4f59b-11b4-4822-95bb-94c398053b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:15.758746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4f59b-11b4-4822-95bb-94c398053b62 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:15.770126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 974/1939] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:15.774124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4f59b-11b4-4822-95bb-94c398053b62 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:15.784006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4f59b-11b4-4822-95bb-94c398053b62 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:15.788898 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2615878-89f4-481c-8573-157191e69b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:15.789534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2615878-89f4-481c-8573-157191e69b4e admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.789818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2615878-89f4-481c-8573-157191e69b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.790091 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2615878-89f4-481c-8573-157191e69b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.790730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2615878-89f4-481c-8573-157191e69b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:15.792322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2615878-89f4-481c-8573-157191e69b4e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:15.807187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 975/1940] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:15.808651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2615878-89f4-481c-8573-157191e69b4e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:15.832557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2615878-89f4-481c-8573-157191e69b4e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:15.836580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcd63a-37f0-442a-a058-45ceaa3e5df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:15.837235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcd63a-37f0-442a-a058-45ceaa3e5df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.837596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcd63a-37f0-442a-a058-45ceaa3e5df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.837873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcd63a-37f0-442a-a058-45ceaa3e5df9 admin admin] PATH_INFO: `/v3/projects/fdb76703d5694ff080c4dcd89f5ad1ef/users/63fc67ad86864d7a82deaddc09ce3e9d/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.852660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcd63a-37f0-442a-a058-45ceaa3e5df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb76703d5694ff080c4dcd89f5ad1ef, user_id=63fc67ad86864d7a82deaddc09ce3e9d, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:15.856068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcd63a-37f0-442a-a058-45ceaa3e5df9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:15.867906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd6bb97e185474d98d551947f07d0be'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.880734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd6bb97e185474d98d551947f07d0be'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.892543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd6bb97e185474d98d551947f07d0be'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.893262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd6bb97e185474d98d551947f07d0be'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.893916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-85e3ab31-7c73-47ec-bb0b-809981810f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd6bb97e185474d98d551947f07d0be'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:15.941931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 976/1941] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:15 2022] PUT /identity/v3/projects/fdb76703d5694ff080c4dcd89f5ad1ef/users/63fc67ad86864d7a82deaddc09ce3e9d/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:15.951948 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b00a54-d48c-4543-9f36-85cbf93231a3 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:15.952326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b00a54-d48c-4543-9f36-85cbf93231a3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:15.952502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b00a54-d48c-4543-9f36-85cbf93231a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:15.985145 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-57b00a54-d48c-4543-9f36-85cbf93231a3 None None] MFA Rules not processed for user `63fc67ad86864d7a82deaddc09ce3e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:15.987063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-57b00a54-d48c-4543-9f36-85cbf93231a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:16.036264 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 966/1942] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:15 2022] DELETE /identity/v3/users/bcd6bb97e185474d98d551947f07d0be => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:16.040819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a92b-ac99-4757-98ee-4accaa8090d2 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.041544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a92b-ac99-4757-98ee-4accaa8090d2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.042449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a92b-ac99-4757-98ee-4accaa8090d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.067102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-fb00a92b-ac99-4757-98ee-4accaa8090d2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:16.068337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fb00a92b-ac99-4757-98ee-4accaa8090d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:16.084385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 977/1943] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:16.088990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b00a54-d48c-4543-9f36-85cbf93231a3 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:16.091253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-57b00a54-d48c-4543-9f36-85cbf93231a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:16.162007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 967/1944] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:16.177080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a92b-ac99-4757-98ee-4accaa8090d2 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:16.178646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fb00a92b-ac99-4757-98ee-4accaa8090d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:16.234798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b00a54-d48c-4543-9f36-85cbf93231a3 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:16.241195 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384558b-e0d3-4aae-bbad-8c6370cc2fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:16.244492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384558b-e0d3-4aae-bbad-8c6370cc2fbb admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.244492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384558b-e0d3-4aae-bbad-8c6370cc2fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.244492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384558b-e0d3-4aae-bbad-8c6370cc2fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.244492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384558b-e0d3-4aae-bbad-8c6370cc2fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:16.245156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384558b-e0d3-4aae-bbad-8c6370cc2fbb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:16.262762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:16.293697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:16.299422 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a92b-ac99-4757-98ee-4accaa8090d2 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:16.303153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb878b88-2a3e-433d-b036-dc65098520fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:16.303778 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb878b88-2a3e-433d-b036-dc65098520fc service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.304046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb878b88-2a3e-433d-b036-dc65098520fc service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.304319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb878b88-2a3e-433d-b036-dc65098520fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.314778 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb878b88-2a3e-433d-b036-dc65098520fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:16.315957 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb878b88-2a3e-433d-b036-dc65098520fc service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:16.328489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 968/1945] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:01:16.330000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb878b88-2a3e-433d-b036-dc65098520fc service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:16.331681 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bb878b88-2a3e-433d-b036-dc65098520fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:16.355019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 978/1946] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:16 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:16.357007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384558b-e0d3-4aae-bbad-8c6370cc2fbb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:16.359132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb878b88-2a3e-433d-b036-dc65098520fc service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:16.457555 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:16.458277 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.458930 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.458930 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] PATH_INFO: `/v3/projects/bbdbdf3c58de41d681fc1faca2eb8132` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.460206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbdbdf3c58de41d681fc1faca2eb8132)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:16.462206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:16.473907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384558b-e0d3-4aae-bbad-8c6370cc2fbb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:16.481224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f766ad-ebe2-45ce-959e-ce673166c928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:16.481914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f766ad-ebe2-45ce-959e-ce673166c928 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.482156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f766ad-ebe2-45ce-959e-ce673166c928 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.482443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f766ad-ebe2-45ce-959e-ce673166c928 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.485943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f766ad-ebe2-45ce-959e-ce673166c928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:16.485943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f766ad-ebe2-45ce-959e-ce673166c928 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:16.587363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 979/1947] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:16 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:16.593627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f766ad-ebe2-45ce-959e-ce673166c928 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:16.618997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f766ad-ebe2-45ce-959e-ce673166c928 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:16.620957 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdbdf3c58de41d681fc1faca2eb8132', 'request_id': 'req-1cfa0853-d336-43e3-a643-079ee6259c77'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:16.630873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdbdf3c58de41d681fc1faca2eb8132', 'request_id': 'req-1cfa0853-d336-43e3-a643-079ee6259c77'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:16.686988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2241e-e4bc-4e7e-a8c9-3e8c9dbc7c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:16.687595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2241e-e4bc-4e7e-a8c9-3e8c9dbc7c90 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.687877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2241e-e4bc-4e7e-a8c9-3e8c9dbc7c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.688150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2241e-e4bc-4e7e-a8c9-3e8c9dbc7c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.689389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2241e-e4bc-4e7e-a8c9-3e8c9dbc7c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:16.691051 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2241e-e4bc-4e7e-a8c9-3e8c9dbc7c90 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:16.698863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdbdf3c58de41d681fc1faca2eb8132', 'request_id': 'req-1cfa0853-d336-43e3-a643-079ee6259c77'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:16.701819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 980/1948] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:16.705730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2241e-e4bc-4e7e-a8c9-3e8c9dbc7c90 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:16.712193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] The token cache is being invalidate because project bbdbdf3c58de41d681fc1faca2eb8132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:16.712193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:16.713441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1cfa0853-d336-43e3-a643-079ee6259c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:16.715024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 969/1949] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:16 2022] DELETE /identity/v3/projects/bbdbdf3c58de41d681fc1faca2eb8132 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:16.717487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2241e-e4bc-4e7e-a8c9-3e8c9dbc7c90 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:16.723160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3dfcf-8b99-4308-be13-120567554d49 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.724111 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3dfcf-8b99-4308-be13-120567554d49 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.724449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3dfcf-8b99-4308-be13-120567554d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.728634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ae372-ab25-430d-983c-a5e38a3ccead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:16.729333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ae372-ab25-430d-983c-a5e38a3ccead admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.729617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ae372-ab25-430d-983c-a5e38a3ccead admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.729897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ae372-ab25-430d-983c-a5e38a3ccead admin admin] PATH_INFO: `/v3/projects/5c6d14ea9eb04e1c93f1906e429e7df2/users/c9e5668ff31f4a039d96d6a40e8d50e8/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.749510 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f5d3dfcf-8b99-4308-be13-120567554d49 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:16.750732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f5d3dfcf-8b99-4308-be13-120567554d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:16.752274 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ae372-ab25-430d-983c-a5e38a3ccead admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6d14ea9eb04e1c93f1906e429e7df2, user_id=c9e5668ff31f4a039d96d6a40e8d50e8, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:16.755163 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ae372-ab25-430d-983c-a5e38a3ccead admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:16.759436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 970/1950] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:16.774798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3468651-06f9-45c1-aad4-194e5be6cdf9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.775272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3468651-06f9-45c1-aad4-194e5be6cdf9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.775722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3468651-06f9-45c1-aad4-194e5be6cdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.799120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f3468651-06f9-45c1-aad4-194e5be6cdf9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:16.800344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f3468651-06f9-45c1-aad4-194e5be6cdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:16.812695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 971/1951] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:16.818905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3468651-06f9-45c1-aad4-194e5be6cdf9 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:16.820550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f3468651-06f9-45c1-aad4-194e5be6cdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:16.843321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 981/1952] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:16 2022] PUT /identity/v3/projects/5c6d14ea9eb04e1c93f1906e429e7df2/users/c9e5668ff31f4a039d96d6a40e8d50e8/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:16.843321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ae372-ab25-430d-983c-a5e38a3ccead admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:16.851229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3468651-06f9-45c1-aad4-194e5be6cdf9 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:16.920018 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:16.920987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.921264 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.921793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] PATH_INFO: `/v3/projects/4443d226e3ed4b69a1ecb666a1965424` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.923764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4443d226e3ed4b69a1ecb666a1965424)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:16.926611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:16.939525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ae372-ab25-430d-983c-a5e38a3ccead admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:16.954286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48952821-5b92-4ed9-8bad-32bc697adad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:16.955343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48952821-5b92-4ed9-8bad-32bc697adad6 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:16.955797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48952821-5b92-4ed9-8bad-32bc697adad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:16.956254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48952821-5b92-4ed9-8bad-32bc697adad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:16.957109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48952821-5b92-4ed9-8bad-32bc697adad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:16.957604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48952821-5b92-4ed9-8bad-32bc697adad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:16.959479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48952821-5b92-4ed9-8bad-32bc697adad6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:16.992487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 982/1953] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:16.992487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48952821-5b92-4ed9-8bad-32bc697adad6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:16.994581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-48952821-5b92-4ed9-8bad-32bc697adad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:17.008885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48952821-5b92-4ed9-8bad-32bc697adad6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:17.014377 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89891a34-ac54-4d08-b255-8c8b3e6821f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:17.014986 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89891a34-ac54-4d08-b255-8c8b3e6821f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.015261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89891a34-ac54-4d08-b255-8c8b3e6821f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.015533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89891a34-ac54-4d08-b255-8c8b3e6821f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.016353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89891a34-ac54-4d08-b255-8c8b3e6821f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:17.018060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89891a34-ac54-4d08-b255-8c8b3e6821f7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:17.029257 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 983/1954] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:17.030435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89891a34-ac54-4d08-b255-8c8b3e6821f7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:17.040994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89891a34-ac54-4d08-b255-8c8b3e6821f7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:17.045395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4443d226e3ed4b69a1ecb666a1965424', 'request_id': 'req-64ae9c6f-14dd-40c0-be13-e64f0d012068'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:17.054358 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4443d226e3ed4b69a1ecb666a1965424', 'request_id': 'req-64ae9c6f-14dd-40c0-be13-e64f0d012068'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:17.113398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a453c-eb04-4630-8478-1adf8782080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:17.114008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a453c-eb04-4630-8478-1adf8782080a admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.114570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a453c-eb04-4630-8478-1adf8782080a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.114678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a453c-eb04-4630-8478-1adf8782080a admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.115696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a453c-eb04-4630-8478-1adf8782080a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:17.117193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a453c-eb04-4630-8478-1adf8782080a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:17.121911 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:17.133268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4443d226e3ed4b69a1ecb666a1965424', 'request_id': 'req-64ae9c6f-14dd-40c0-be13-e64f0d012068'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:17.147227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] The token cache is being invalidate because project 4443d226e3ed4b69a1ecb666a1965424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:17.147524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:17.148211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:17.149937 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 972/1955] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:16 2022] DELETE /identity/v3/projects/4443d226e3ed4b69a1ecb666a1965424 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:17.150868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:17.152180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:17.165409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9c6f-14dd-40c0-be13-e64f0d012068 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:17.170622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b93823-638d-4316-99c4-2b1f41ae399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:17.171279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b93823-638d-4316-99c4-2b1f41ae399a admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.171558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b93823-638d-4316-99c4-2b1f41ae399a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.172116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b93823-638d-4316-99c4-2b1f41ae399a admin admin] PATH_INFO: `/v3/projects/5c6d14ea9eb04e1c93f1906e429e7df2/users/c9e5668ff31f4a039d96d6a40e8d50e8/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.174298 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b93823-638d-4316-99c4-2b1f41ae399a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6d14ea9eb04e1c93f1906e429e7df2, user_id=c9e5668ff31f4a039d96d6a40e8d50e8, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:17.176420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:17.180121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b93823-638d-4316-99c4-2b1f41ae399a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:17.191822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 973/1956] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:17 2022] PUT /identity/v3/projects/5c6d14ea9eb04e1c93f1906e429e7df2/users/c9e5668ff31f4a039d96d6a40e8d50e8/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:17.192727 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b93823-638d-4316-99c4-2b1f41ae399a admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:17.206839 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-28b93823-638d-4316-99c4-2b1f41ae399a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:17.210149 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 984/1957] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:17 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:17.212152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b300fe-750c-40a4-bfdc-c6e88bcb4ed0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.212692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b300fe-750c-40a4-bfdc-c6e88bcb4ed0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.213165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b300fe-750c-40a4-bfdc-c6e88bcb4ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.248272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-91b300fe-750c-40a4-bfdc-c6e88bcb4ed0 None None] MFA Rules not processed for user `c9e5668ff31f4a039d96d6a40e8d50e8`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:17.249567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-91b300fe-750c-40a4-bfdc-c6e88bcb4ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:17.289283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b93823-638d-4316-99c4-2b1f41ae399a admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:17.346541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 985/1958] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:17.357073 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b300fe-750c-40a4-bfdc-c6e88bcb4ed0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:17.358656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-91b300fe-750c-40a4-bfdc-c6e88bcb4ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:17.383828 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:17.384459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.384732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.385368 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] PATH_INFO: `/v3/users/6c87a86613264c829205e84a7ea1ac75` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.386325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c87a86613264c829205e84a7ea1ac75)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:17.388226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:17.429645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b300fe-750c-40a4-bfdc-c6e88bcb4ed0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:17.434161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a78fa-46ef-4e83-b8fa-20d57e032b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:17.434761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a78fa-46ef-4e83-b8fa-20d57e032b6e admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.435035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a78fa-46ef-4e83-b8fa-20d57e032b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.435305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a78fa-46ef-4e83-b8fa-20d57e032b6e admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.435915 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a78fa-46ef-4e83-b8fa-20d57e032b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:17.437840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a78fa-46ef-4e83-b8fa-20d57e032b6e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:17.533759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 986/1959] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:17 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:17.535447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a78fa-46ef-4e83-b8fa-20d57e032b6e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:17.537724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2f0a78fa-46ef-4e83-b8fa-20d57e032b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:17.551320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c87a86613264c829205e84a7ea1ac75'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:17.569628 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c87a86613264c829205e84a7ea1ac75'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:17.582695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c87a86613264c829205e84a7ea1ac75'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:17.583545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c87a86613264c829205e84a7ea1ac75'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:17.584272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c87a86613264c829205e84a7ea1ac75'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:17.615260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a78fa-46ef-4e83-b8fa-20d57e032b6e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:17.615260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b52800-6faf-4e5f-b0a7-6447caf97fbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:17.615260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b52800-6faf-4e5f-b0a7-6447caf97fbf service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.615260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b52800-6faf-4e5f-b0a7-6447caf97fbf service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.616219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b52800-6faf-4e5f-b0a7-6447caf97fbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.616219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-07b52800-6faf-4e5f-b0a7-6447caf97fbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:17.620365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b52800-6faf-4e5f-b0a7-6447caf97fbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:17.621988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b52800-6faf-4e5f-b0a7-6447caf97fbf service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:17.632328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 987/1960] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:17.632989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b52800-6faf-4e5f-b0a7-6447caf97fbf service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:17.634344 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-07b52800-6faf-4e5f-b0a7-6447caf97fbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:17.647999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b52800-6faf-4e5f-b0a7-6447caf97fbf service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:17.653258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118b088-0935-4703-94ff-2b267921676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:17.653885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b088-0935-4703-94ff-2b267921676d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.654162 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b088-0935-4703-94ff-2b267921676d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.654949 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b088-0935-4703-94ff-2b267921676d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.655055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118b088-0935-4703-94ff-2b267921676d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:17.656631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118b088-0935-4703-94ff-2b267921676d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:17.667045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 988/1961] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:17.671354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118b088-0935-4703-94ff-2b267921676d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:17.672781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 974/1962] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:17 2022] DELETE /identity/v3/users/6c87a86613264c829205e84a7ea1ac75 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:17.691827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118b088-0935-4703-94ff-2b267921676d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:17.713279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:17.714750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:17.758696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0edb4e-18df-4ac2-9de5-83490d2fe225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:17.759347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0edb4e-18df-4ac2-9de5-83490d2fe225 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.759578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0edb4e-18df-4ac2-9de5-83490d2fe225 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.759849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0edb4e-18df-4ac2-9de5-83490d2fe225 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.760489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0edb4e-18df-4ac2-9de5-83490d2fe225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:17.762116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0edb4e-18df-4ac2-9de5-83490d2fe225 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:17.773332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 989/1963] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:17.776990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0edb4e-18df-4ac2-9de5-83490d2fe225 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:17.786861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0edb4e-18df-4ac2-9de5-83490d2fe225 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:17.790823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f5b7e-9ecd-4348-8d6b-8508a591e92e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:17.791582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7b3b5-73cb-4fbd-87e7-82112d2f4eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:17.792222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7b3b5-73cb-4fbd-87e7-82112d2f4eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.792501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7b3b5-73cb-4fbd-87e7-82112d2f4eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.792770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7b3b5-73cb-4fbd-87e7-82112d2f4eb9 admin admin] PATH_INFO: `/v3/projects/9a630fb8707643ee8d7dee2226ee7d9b/users/306bc54e284c4d908e591dd94fbbe591/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.795698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:17.796350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.796626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.796892 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] PATH_INFO: `/v3/users/63fc67ad86864d7a82deaddc09ce3e9d` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.798092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fc67ad86864d7a82deaddc09ce3e9d)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:17.800127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:17.804051 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:17.809340 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7b3b5-73cb-4fbd-87e7-82112d2f4eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a630fb8707643ee8d7dee2226ee7d9b, user_id=306bc54e284c4d908e591dd94fbbe591, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:17.811971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7b3b5-73cb-4fbd-87e7-82112d2f4eb9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:17.887923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:17.900352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 990/1964] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:17 2022] PUT /identity/v3/projects/9a630fb8707643ee8d7dee2226ee7d9b/users/306bc54e284c4d908e591dd94fbbe591/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:17.905139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231165f-289a-4d32-8818-c8986ac5a5be None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:17.905492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231165f-289a-4d32-8818-c8986ac5a5be None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:17.905749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231165f-289a-4d32-8818-c8986ac5a5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:17.933169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e231165f-289a-4d32-8818-c8986ac5a5be None None] MFA Rules not processed for user `306bc54e284c4d908e591dd94fbbe591`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:17.934435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e231165f-289a-4d32-8818-c8986ac5a5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:17.991326 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fc67ad86864d7a82deaddc09ce3e9d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:18.003052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fc67ad86864d7a82deaddc09ce3e9d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:18.004407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 991/1965] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:18.008849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231165f-289a-4d32-8818-c8986ac5a5be None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:18.025992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fc67ad86864d7a82deaddc09ce3e9d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:18.026843 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fc67ad86864d7a82deaddc09ce3e9d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:18.027512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fc67ad86864d7a82deaddc09ce3e9d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:18.087789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231165f-289a-4d32-8818-c8986ac5a5be None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:18.093058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6277506-fc56-4daa-bc7d-dc58a55a6447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:18.093703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6277506-fc56-4daa-bc7d-dc58a55a6447 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.093980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6277506-fc56-4daa-bc7d-dc58a55a6447 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.094251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6277506-fc56-4daa-bc7d-dc58a55a6447 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.095438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6277506-fc56-4daa-bc7d-dc58a55a6447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:18.097370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6277506-fc56-4daa-bc7d-dc58a55a6447 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:18.158042 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 975/1966] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:17 2022] DELETE /identity/v3/users/63fc67ad86864d7a82deaddc09ce3e9d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:18.162462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:18.177475 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:18.242291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 992/1967] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:18 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:18.243477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d471f17-0657-45a4-b11c-38a78a22358a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.243786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d471f17-0657-45a4-b11c-38a78a22358a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.244063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d471f17-0657-45a4-b11c-38a78a22358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.263505 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e310b0d-c6fe-46bf-bb05-89f182d2fe99 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:18.268321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4d471f17-0657-45a4-b11c-38a78a22358a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:18.268321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4d471f17-0657-45a4-b11c-38a78a22358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:18.324292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:18.324925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.325201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.325551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] PATH_INFO: `/v3/projects/3ba3cba55ddf45ce816055dd8e157d91` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.326669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba3cba55ddf45ce816055dd8e157d91)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:18.328549 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:18.330958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 993/1968] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:18.331679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d471f17-0657-45a4-b11c-38a78a22358a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:18.332955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4d471f17-0657-45a4-b11c-38a78a22358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:18.347248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d471f17-0657-45a4-b11c-38a78a22358a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:18.353090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc80b56-95b8-4610-b0ff-7ffcf71a4a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:18.353779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc80b56-95b8-4610-b0ff-7ffcf71a4a47 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.354065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc80b56-95b8-4610-b0ff-7ffcf71a4a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.354417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc80b56-95b8-4610-b0ff-7ffcf71a4a47 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.355125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc80b56-95b8-4610-b0ff-7ffcf71a4a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:18.357130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc80b56-95b8-4610-b0ff-7ffcf71a4a47 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:18.455875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 994/1969] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:18 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:18.456720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc80b56-95b8-4610-b0ff-7ffcf71a4a47 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:18.463211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba3cba55ddf45ce816055dd8e157d91', 'request_id': 'req-645e4a08-5970-4178-8097-7acb405c02a7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:18.463930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bbc80b56-95b8-4610-b0ff-7ffcf71a4a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:18.477129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba3cba55ddf45ce816055dd8e157d91', 'request_id': 'req-645e4a08-5970-4178-8097-7acb405c02a7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:18.556964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc80b56-95b8-4610-b0ff-7ffcf71a4a47 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:18.562049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba3cba55ddf45ce816055dd8e157d91', 'request_id': 'req-645e4a08-5970-4178-8097-7acb405c02a7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:18.586052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] The token cache is being invalidate because project 3ba3cba55ddf45ce816055dd8e157d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:18.586820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:18.587587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:18.590114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 976/1970] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:18 2022] DELETE /identity/v3/projects/3ba3cba55ddf45ce816055dd8e157d91 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:18.591286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:18.592953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:18.627626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:18.641701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e56e99-7c8f-4e21-bb70-6bce53b0711b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:18.642522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e56e99-7c8f-4e21-bb70-6bce53b0711b service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.643136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e56e99-7c8f-4e21-bb70-6bce53b0711b service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.643585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e56e99-7c8f-4e21-bb70-6bce53b0711b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.646000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-67e56e99-7c8f-4e21-bb70-6bce53b0711b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:18.671644 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e4a08-5970-4178-8097-7acb405c02a7 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:18.677500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddfa82-2a9e-4ccb-acf7-4426d2eb73a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:18.678102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddfa82-2a9e-4ccb-acf7-4426d2eb73a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.678358 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddfa82-2a9e-4ccb-acf7-4426d2eb73a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.678633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddfa82-2a9e-4ccb-acf7-4426d2eb73a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.679287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddfa82-2a9e-4ccb-acf7-4426d2eb73a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:18.680899 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddfa82-2a9e-4ccb-acf7-4426d2eb73a9 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:18.692935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 977/1971] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:18.694320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de3ecb-7154-4cbf-bdee-0f5e119e6c82 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.694670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de3ecb-7154-4cbf-bdee-0f5e119e6c82 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.695008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de3ecb-7154-4cbf-bdee-0f5e119e6c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.715012 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-14de3ecb-7154-4cbf-bdee-0f5e119e6c82 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:18.716630 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-14de3ecb-7154-4cbf-bdee-0f5e119e6c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:18.725162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 978/1972] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:18.725912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e56e99-7c8f-4e21-bb70-6bce53b0711b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:18.726031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de3ecb-7154-4cbf-bdee-0f5e119e6c82 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:18.727436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e56e99-7c8f-4e21-bb70-6bce53b0711b service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:18.736026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de3ecb-7154-4cbf-bdee-0f5e119e6c82 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:18.740401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 995/1973] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:18.741769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ca145-fb6b-4b08-9f9b-2f93b789966d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.742059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ca145-fb6b-4b08-9f9b-2f93b789966d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.743456 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ca145-fb6b-4b08-9f9b-2f93b789966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.744102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6803b-187f-47d5-aa07-acd535605789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:18.744715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6803b-187f-47d5-aa07-acd535605789 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.744988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6803b-187f-47d5-aa07-acd535605789 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.745340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6803b-187f-47d5-aa07-acd535605789 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.745925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6803b-187f-47d5-aa07-acd535605789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:18.747619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6803b-187f-47d5-aa07-acd535605789 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:18.767335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 979/1974] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:18.769719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6803b-187f-47d5-aa07-acd535605789 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:18.777775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-463ca145-fb6b-4b08-9f9b-2f93b789966d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:18.778970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-463ca145-fb6b-4b08-9f9b-2f93b789966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:18.784744 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6803b-187f-47d5-aa07-acd535605789 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:18.789341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 996/1975] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:18.793510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ca145-fb6b-4b08-9f9b-2f93b789966d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:18.800412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cd734-ee1c-44fb-9955-4f4f5c126545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:18.801324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd734-ee1c-44fb-9955-4f4f5c126545 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.801627 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd734-ee1c-44fb-9955-4f4f5c126545 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.806738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd734-ee1c-44fb-9955-4f4f5c126545 admin admin] PATH_INFO: `/v3/projects/d244d89c7a304e508ba12fc36ae01da9/users/f661bca5a4a149a98c266842efc67563/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.810026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ca145-fb6b-4b08-9f9b-2f93b789966d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:18.817339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94b03b-24d8-4ab6-a683-360bf39775bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:18.818168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94b03b-24d8-4ab6-a683-360bf39775bb admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.818448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94b03b-24d8-4ab6-a683-360bf39775bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.818868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94b03b-24d8-4ab6-a683-360bf39775bb admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.819910 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94b03b-24d8-4ab6-a683-360bf39775bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:18.820215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94b03b-24d8-4ab6-a683-360bf39775bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:18.821923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94b03b-24d8-4ab6-a683-360bf39775bb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:18.834279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cd734-ee1c-44fb-9955-4f4f5c126545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d244d89c7a304e508ba12fc36ae01da9, user_id=f661bca5a4a149a98c266842efc67563, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:18.841836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cd734-ee1c-44fb-9955-4f4f5c126545 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:18.847753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 997/1976] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:18.867280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94b03b-24d8-4ab6-a683-360bf39775bb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:18.883172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94b03b-24d8-4ab6-a683-360bf39775bb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:18.896195 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56861541-b6e6-41c1-a13a-caf7b4f93597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:18.897755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861541-b6e6-41c1-a13a-caf7b4f93597 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:18.897997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861541-b6e6-41c1-a13a-caf7b4f93597 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:18.898452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861541-b6e6-41c1-a13a-caf7b4f93597 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:18.899510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56861541-b6e6-41c1-a13a-caf7b4f93597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:18.902063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56861541-b6e6-41c1-a13a-caf7b4f93597 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:18.998525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 980/1977] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:18 2022] PUT /identity/v3/projects/d244d89c7a304e508ba12fc36ae01da9/users/f661bca5a4a149a98c266842efc67563/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:19.012349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1edcd-0503-419b-8673-463f66ca5c8f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.012641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1edcd-0503-419b-8673-463f66ca5c8f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.014014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1edcd-0503-419b-8673-463f66ca5c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.020184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 998/1978] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:18 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:19.025059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56861541-b6e6-41c1-a13a-caf7b4f93597 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.054691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ded1edcd-0503-419b-8673-463f66ca5c8f None None] MFA Rules not processed for user `f661bca5a4a149a98c266842efc67563`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:19.056208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ded1edcd-0503-419b-8673-463f66ca5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:19.110994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56861541-b6e6-41c1-a13a-caf7b4f93597 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.117256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3083e7-dc6f-4aed-a488-e4107b6a3f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.118072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3083e7-dc6f-4aed-a488-e4107b6a3f42 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.118361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3083e7-dc6f-4aed-a488-e4107b6a3f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.118748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3083e7-dc6f-4aed-a488-e4107b6a3f42 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.119434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3083e7-dc6f-4aed-a488-e4107b6a3f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:19.121581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3083e7-dc6f-4aed-a488-e4107b6a3f42 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:19.149000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 981/1979] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:19.153393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1edcd-0503-419b-8673-463f66ca5c8f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.165210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1edcd-0503-419b-8673-463f66ca5c8f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.169876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe18a2-1305-46a1-a463-02238449c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.170491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe18a2-1305-46a1-a463-02238449c96a admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.170765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe18a2-1305-46a1-a463-02238449c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.171067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe18a2-1305-46a1-a463-02238449c96a admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.171747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe18a2-1305-46a1-a463-02238449c96a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:19.174297 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe18a2-1305-46a1-a463-02238449c96a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:19.196319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:19.234839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 999/1980] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:19 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:19.239882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3083e7-dc6f-4aed-a488-e4107b6a3f42 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.250970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3083e7-dc6f-4aed-a488-e4107b6a3f42 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.259116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7376dd-2b2a-4d90-8818-20b67a602b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.259892 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7376dd-2b2a-4d90-8818-20b67a602b40 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.260171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7376dd-2b2a-4d90-8818-20b67a602b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.262519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7376dd-2b2a-4d90-8818-20b67a602b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.262519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7376dd-2b2a-4d90-8818-20b67a602b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:19.263956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7376dd-2b2a-4d90-8818-20b67a602b40 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:19.267995 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 982/1981] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:19 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:19.269437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe18a2-1305-46a1-a463-02238449c96a admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.278673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1000/1982] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:19.280485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7376dd-2b2a-4d90-8818-20b67a602b40 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.294360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7376dd-2b2a-4d90-8818-20b67a602b40 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.359358 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe18a2-1305-46a1-a463-02238449c96a admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.366991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ed6d-d10e-4576-98e3-bffcbfb4cf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.367933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ed6d-d10e-4576-98e3-bffcbfb4cf12 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.368613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ed6d-d10e-4576-98e3-bffcbfb4cf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.369221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ed6d-d10e-4576-98e3-bffcbfb4cf12 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.372125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81ed6d-d10e-4576-98e3-bffcbfb4cf12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:19.374817 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81ed6d-d10e-4576-98e3-bffcbfb4cf12 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:19.409361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ecc94-6a6c-484b-97d1-f6fb2c3cfed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.410084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ecc94-6a6c-484b-97d1-f6fb2c3cfed1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.410426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ecc94-6a6c-484b-97d1-f6fb2c3cfed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.411047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ecc94-6a6c-484b-97d1-f6fb2c3cfed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.412085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ecc94-6a6c-484b-97d1-f6fb2c3cfed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:19.413385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ecc94-6a6c-484b-97d1-f6fb2c3cfed1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:19.424210 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1001/1983] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:19.430291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ecc94-6a6c-484b-97d1-f6fb2c3cfed1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.441516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ecc94-6a6c-484b-97d1-f6fb2c3cfed1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.446930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5f093-8add-4f03-b2ef-3438e3643b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.447860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5f093-8add-4f03-b2ef-3438e3643b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.448203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5f093-8add-4f03-b2ef-3438e3643b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.448553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5f093-8add-4f03-b2ef-3438e3643b3a admin admin] PATH_INFO: `/v3/projects/d663d479996643c598e3da0011ed05ad/users/b1e7b39248ef4a8ba7f3ebf5df1372ea/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.468703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5f093-8add-4f03-b2ef-3438e3643b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d663d479996643c598e3da0011ed05ad, user_id=b1e7b39248ef4a8ba7f3ebf5df1372ea, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:19.472548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5f093-8add-4f03-b2ef-3438e3643b3a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:19.508773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 983/1984] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:19 2022] POST /identity/v3/users => generated 295 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:19.510351 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ed6d-d10e-4576-98e3-bffcbfb4cf12 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.521154 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ed6d-d10e-4576-98e3-bffcbfb4cf12 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.526190 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf55cd-bb21-4e51-8fd3-26f983885933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.526750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf55cd-bb21-4e51-8fd3-26f983885933 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.527041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf55cd-bb21-4e51-8fd3-26f983885933 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.527311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf55cd-bb21-4e51-8fd3-26f983885933 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.527943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf55cd-bb21-4e51-8fd3-26f983885933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:19.529551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf55cd-bb21-4e51-8fd3-26f983885933 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:19.540534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 984/1985] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:19.544507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf55cd-bb21-4e51-8fd3-26f983885933 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.555458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf55cd-bb21-4e51-8fd3-26f983885933 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.564655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221968f9-91c4-4946-b422-9e342023e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.565714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221968f9-91c4-4946-b422-9e342023e926 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.565857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221968f9-91c4-4946-b422-9e342023e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.566171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221968f9-91c4-4946-b422-9e342023e926 admin admin] PATH_INFO: `/v3/projects/142360831fac4814954676f85fa8c429/users/de1aebc610ce40298b525f622086c1da/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.571323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1002/1986] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:19 2022] PUT /identity/v3/projects/d663d479996643c598e3da0011ed05ad/users/b1e7b39248ef4a8ba7f3ebf5df1372ea/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:19.591938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10f47-37c8-448b-ba20-1fb06f340c14 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.592559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10f47-37c8-448b-ba20-1fb06f340c14 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.592838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10f47-37c8-448b-ba20-1fb06f340c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.611650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221968f9-91c4-4946-b422-9e342023e926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142360831fac4814954676f85fa8c429, user_id=de1aebc610ce40298b525f622086c1da, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:19.617003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221968f9-91c4-4946-b422-9e342023e926 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:19.647173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f1d10f47-37c8-448b-ba20-1fb06f340c14 None None] MFA Rules not processed for user `b1e7b39248ef4a8ba7f3ebf5df1372ea`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:19.649151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f1d10f47-37c8-448b-ba20-1fb06f340c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:19.735334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1003/1987] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:19.739475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10f47-37c8-448b-ba20-1fb06f340c14 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.811399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 985/1988] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:19 2022] PUT /identity/v3/projects/142360831fac4814954676f85fa8c429/users/de1aebc610ce40298b525f622086c1da/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:19.816059 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221968f9-91c4-4946-b422-9e342023e926 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.829742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10f47-37c8-448b-ba20-1fb06f340c14 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.887861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:19.933961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221968f9-91c4-4946-b422-9e342023e926 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.940470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bc393-95eb-47f5-921d-323dd3c387fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.941442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bc393-95eb-47f5-921d-323dd3c387fd admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.941866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bc393-95eb-47f5-921d-323dd3c387fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.942281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bc393-95eb-47f5-921d-323dd3c387fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.943324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bc393-95eb-47f5-921d-323dd3c387fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:19.943764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d742ff-e376-43ba-9eab-b76230161244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.945081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d742ff-e376-43ba-9eab-b76230161244 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.945579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d742ff-e376-43ba-9eab-b76230161244 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.946025 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d742ff-e376-43ba-9eab-b76230161244 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.946482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bc393-95eb-47f5-921d-323dd3c387fd admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:19.946781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d742ff-e376-43ba-9eab-b76230161244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:19.950563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d742ff-e376-43ba-9eab-b76230161244 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:19.969215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 986/1989] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:19.969215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bc393-95eb-47f5-921d-323dd3c387fd admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:19.975385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-570bc393-95eb-47f5-921d-323dd3c387fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:19.990222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bc393-95eb-47f5-921d-323dd3c387fd admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:19.995833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:19.996600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:19.996884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:19.997171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] PATH_INFO: `/v3/projects/fdb76703d5694ff080c4dcd89f5ad1ef` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:19.998308 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb76703d5694ff080c4dcd89f5ad1ef)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:20.000278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:20.067944 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1004/1990] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:19 2022] POST /identity/v3/projects => generated 393 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:20.070753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d742ff-e376-43ba-9eab-b76230161244 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:20.124917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb76703d5694ff080c4dcd89f5ad1ef', 'request_id': 'req-09b32d89-3eb7-4401-95c4-d454d760c423'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.132660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb76703d5694ff080c4dcd89f5ad1ef', 'request_id': 'req-09b32d89-3eb7-4401-95c4-d454d760c423'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.141047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d742ff-e376-43ba-9eab-b76230161244 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:20.184522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb76703d5694ff080c4dcd89f5ad1ef', 'request_id': 'req-09b32d89-3eb7-4401-95c4-d454d760c423'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.197708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] The token cache is being invalidate because project fdb76703d5694ff080c4dcd89f5ad1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:20.197708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.198096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.201534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 987/1991] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:19 2022] DELETE /identity/v3/projects/fdb76703d5694ff080c4dcd89f5ad1ef => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:20.201534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:20.202781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a187d35-e8fc-4418-a3b9-27016aee22b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:20.203607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:20.203721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187d35-e8fc-4418-a3b9-27016aee22b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:20.204045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187d35-e8fc-4418-a3b9-27016aee22b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:20.204873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a187d35-e8fc-4418-a3b9-27016aee22b7 admin admin] PATH_INFO: `/v3/projects/142360831fac4814954676f85fa8c429/users/de1aebc610ce40298b525f622086c1da/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:20.207582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a187d35-e8fc-4418-a3b9-27016aee22b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142360831fac4814954676f85fa8c429, user_id=de1aebc610ce40298b525f622086c1da, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:20.210969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a187d35-e8fc-4418-a3b9-27016aee22b7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:20.222882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b32d89-3eb7-4401-95c4-d454d760c423 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:20.223463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1005/1992] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:20 2022] PUT /identity/v3/projects/142360831fac4814954676f85fa8c429/users/de1aebc610ce40298b525f622086c1da/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:20.224264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a187d35-e8fc-4418-a3b9-27016aee22b7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:20.227674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6a187d35-e8fc-4418-a3b9-27016aee22b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:20.328191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a187d35-e8fc-4418-a3b9-27016aee22b7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:20.328347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f805efc-aa62-417e-8d77-c7ab1531f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:20.328921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f805efc-aa62-417e-8d77-c7ab1531f87f admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:20.329131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f805efc-aa62-417e-8d77-c7ab1531f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:20.330830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f805efc-aa62-417e-8d77-c7ab1531f87f admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:20.331537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f805efc-aa62-417e-8d77-c7ab1531f87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:20.334550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:20.335253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:20.335529 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:20.335798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] PATH_INFO: `/v3/users/c9e5668ff31f4a039d96d6a40e8d50e8` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:20.336835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f805efc-aa62-417e-8d77-c7ab1531f87f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:20.337084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e5668ff31f4a039d96d6a40e8d50e8)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:20.339695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:20.429336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 988/1993] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:20 2022] POST /identity/v3/users => generated 303 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:20.429336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c1cf4-1ba6-42f2-b471-4c7c5e21f45c None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:20.429336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c1cf4-1ba6-42f2-b471-4c7c5e21f45c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:20.429611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c1cf4-1ba6-42f2-b471-4c7c5e21f45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:20.458591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-de3c1cf4-1ba6-42f2-b471-4c7c5e21f45c None None] MFA Rules not processed for user `de1aebc610ce40298b525f622086c1da`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:20.459903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-de3c1cf4-1ba6-42f2-b471-4c7c5e21f45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:20.500370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e5668ff31f4a039d96d6a40e8d50e8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.516597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e5668ff31f4a039d96d6a40e8d50e8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.517271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e5668ff31f4a039d96d6a40e8d50e8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.521909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e5668ff31f4a039d96d6a40e8d50e8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.545874 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 989/1994] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:20.546798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c1cf4-1ba6-42f2-b471-4c7c5e21f45c None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:20.548845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-de3c1cf4-1ba6-42f2-b471-4c7c5e21f45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:20.564103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c1cf4-1ba6-42f2-b471-4c7c5e21f45c None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:20.569305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:20.569952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:20.570274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:20.570547 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] PATH_INFO: `/v3/users/369007e0ebea48629887ebfd32e650ea` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:20.571990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=369007e0ebea48629887ebfd32e650ea)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:20.575801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:20.601281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e5668ff31f4a039d96d6a40e8d50e8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.617837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1006/1995] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:20 2022] DELETE /identity/v3/users/c9e5668ff31f4a039d96d6a40e8d50e8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:20.618692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:20.620278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:20.704741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeceec7-f4b2-415d-b305-88dc7dc44fba admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:20.709506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7f709-ade4-4caf-8c75-45630a689bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:20.710139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7f709-ade4-4caf-8c75-45630a689bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:20.710412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7f709-ade4-4caf-8c75-45630a689bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:20.710677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7f709-ade4-4caf-8c75-45630a689bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:20.711308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7f709-ade4-4caf-8c75-45630a689bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:20.712887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7f709-ade4-4caf-8c75-45630a689bf1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:20.724455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1007/1996] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:20.725117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7f709-ade4-4caf-8c75-45630a689bf1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:20.726930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3df7f709-ade4-4caf-8c75-45630a689bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:20.783810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7f709-ade4-4caf-8c75-45630a689bf1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:20.787473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e787b7-c858-474f-adf8-f020f28adf5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:20.788066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e787b7-c858-474f-adf8-f020f28adf5c service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:20.788369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e787b7-c858-474f-adf8-f020f28adf5c service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:20.788671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e787b7-c858-474f-adf8-f020f28adf5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:20.809309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369007e0ebea48629887ebfd32e650ea'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.815983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369007e0ebea48629887ebfd32e650ea'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.827964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369007e0ebea48629887ebfd32e650ea'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.828730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369007e0ebea48629887ebfd32e650ea'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.829974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-cb01a6b0-72b5-473a-8528-a86689a59ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369007e0ebea48629887ebfd32e650ea'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:20.852398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e787b7-c858-474f-adf8-f020f28adf5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:20.853876 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e787b7-c858-474f-adf8-f020f28adf5c service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:20.864097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1008/1997] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:20.868303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e787b7-c858-474f-adf8-f020f28adf5c service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:20.870515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:20.875112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e787b7-c858-474f-adf8-f020f28adf5c service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:20.880349 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403d94d-b10b-4df4-9522-693a8b821963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:20.881104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403d94d-b10b-4df4-9522-693a8b821963 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:20.881416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403d94d-b10b-4df4-9522-693a8b821963 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:20.881761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403d94d-b10b-4df4-9522-693a8b821963 admin admin] PATH_INFO: `/v3/projects/683a79f00337464bbbb75adc3a83b37c/users/e168307fb907439d89f999ca1d3ded2a/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:20.901894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403d94d-b10b-4df4-9522-693a8b821963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683a79f00337464bbbb75adc3a83b37c, user_id=e168307fb907439d89f999ca1d3ded2a, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:20.904747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403d94d-b10b-4df4-9522-693a8b821963 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:20.923734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 990/1998] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:20 2022] DELETE /identity/v3/users/369007e0ebea48629887ebfd32e650ea => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:20.928138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8ecd6-e340-4c1d-92af-c4be3282dafe None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:20.928421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8ecd6-e340-4c1d-92af-c4be3282dafe None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:20.928718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8ecd6-e340-4c1d-92af-c4be3282dafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:20.955535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-83c8ecd6-e340-4c1d-92af-c4be3282dafe None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:20.956875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-83c8ecd6-e340-4c1d-92af-c4be3282dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:20.999315 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1009/1999] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:20 2022] PUT /identity/v3/projects/683a79f00337464bbbb75adc3a83b37c/users/e168307fb907439d89f999ca1d3ded2a/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:21.003674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403d94d-b10b-4df4-9522-693a8b821963 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:21.005702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5403d94d-b10b-4df4-9522-693a8b821963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.067804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 991/2000] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:21.071121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8ecd6-e340-4c1d-92af-c4be3282dafe None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:21.071121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-83c8ecd6-e340-4c1d-92af-c4be3282dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.164118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403d94d-b10b-4df4-9522-693a8b821963 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:21.171120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8ecd6-e340-4c1d-92af-c4be3282dafe None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:21.175877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263318bf-a2a4-43d1-8dda-6fd6626b39e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:21.176627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263318bf-a2a4-43d1-8dda-6fd6626b39e5 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.177007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263318bf-a2a4-43d1-8dda-6fd6626b39e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.177466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263318bf-a2a4-43d1-8dda-6fd6626b39e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.178221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263318bf-a2a4-43d1-8dda-6fd6626b39e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:21.180735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263318bf-a2a4-43d1-8dda-6fd6626b39e5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:21.186680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:21.202113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1010/2001] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:21.203069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263318bf-a2a4-43d1-8dda-6fd6626b39e5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:21.206069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-263318bf-a2a4-43d1-8dda-6fd6626b39e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.244698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf10f2-ba59-4837-8b99-5e7a9e3baac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:21.245334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf10f2-ba59-4837-8b99-5e7a9e3baac9 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.245657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf10f2-ba59-4837-8b99-5e7a9e3baac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.245922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf10f2-ba59-4837-8b99-5e7a9e3baac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.247841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4dbf10f2-ba59-4837-8b99-5e7a9e3baac9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.299847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263318bf-a2a4-43d1-8dda-6fd6626b39e5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:21.304792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccc4dd-a4ce-4072-8cc0-fad7117a825e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:21.305475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccc4dd-a4ce-4072-8cc0-fad7117a825e service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.305853 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccc4dd-a4ce-4072-8cc0-fad7117a825e service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.306124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccc4dd-a4ce-4072-8cc0-fad7117a825e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.316463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf10f2-ba59-4837-8b99-5e7a9e3baac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:21.317664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccc4dd-a4ce-4072-8cc0-fad7117a825e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:21.318135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf10f2-ba59-4837-8b99-5e7a9e3baac9 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:21.319061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccc4dd-a4ce-4072-8cc0-fad7117a825e service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:21.329682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1011/2002] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:21.330517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccc4dd-a4ce-4072-8cc0-fad7117a825e service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:21.332047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-adccc4dd-a4ce-4072-8cc0-fad7117a825e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.339433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 992/2003] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:21.340599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf10f2-ba59-4837-8b99-5e7a9e3baac9 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:21.350022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccc4dd-a4ce-4072-8cc0-fad7117a825e service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:21.357390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:21.358099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.358331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.359215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] PATH_INFO: `/v3/projects/5c6d14ea9eb04e1c93f1906e429e7df2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.362881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6d14ea9eb04e1c93f1906e429e7df2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:21.364071 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf10f2-ba59-4837-8b99-5e7a9e3baac9 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:21.365764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:21.370027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8af2-748f-47a4-b323-06cc480de6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:21.371034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8af2-748f-47a4-b323-06cc480de6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.371446 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8af2-748f-47a4-b323-06cc480de6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.371861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8af2-748f-47a4-b323-06cc480de6eb admin admin] PATH_INFO: `/v3/projects/683a79f00337464bbbb75adc3a83b37c/users/e168307fb907439d89f999ca1d3ded2a/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.374024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc8af2-748f-47a4-b323-06cc480de6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=683a79f00337464bbbb75adc3a83b37c, user_id=e168307fb907439d89f999ca1d3ded2a, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:21.378124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc8af2-748f-47a4-b323-06cc480de6eb admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:21.392253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 993/2004] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:21 2022] PUT /identity/v3/projects/683a79f00337464bbbb75adc3a83b37c/users/e168307fb907439d89f999ca1d3ded2a/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:21.402564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6939db-c38f-4c9d-8222-ca830f1d3949 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.403097 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6939db-c38f-4c9d-8222-ca830f1d3949 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.403370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6939db-c38f-4c9d-8222-ca830f1d3949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.432121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-5c6939db-c38f-4c9d-8222-ca830f1d3949 None None] MFA Rules not processed for user `e168307fb907439d89f999ca1d3ded2a`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:21.433424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5c6939db-c38f-4c9d-8222-ca830f1d3949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.487106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6d14ea9eb04e1c93f1906e429e7df2', 'request_id': 'req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:21.496239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6d14ea9eb04e1c93f1906e429e7df2', 'request_id': 'req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:21.518488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 994/2005] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:21.531293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6939db-c38f-4c9d-8222-ca830f1d3949 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:21.533450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5c6939db-c38f-4c9d-8222-ca830f1d3949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.556266 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6d14ea9eb04e1c93f1906e429e7df2', 'request_id': 'req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:21.569841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] The token cache is being invalidate because project 5c6d14ea9eb04e1c93f1906e429e7df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:21.571049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:21.574509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d1eec2c0-f532-487a-a6d1-e1a8e6155be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:21.576822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1012/2006] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:21 2022] DELETE /identity/v3/projects/5c6d14ea9eb04e1c93f1906e429e7df2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:21.583226 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4150d-29a0-4188-b050-5373ff83ad3f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.583620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4150d-29a0-4188-b050-5373ff83ad3f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.583968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4150d-29a0-4188-b050-5373ff83ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.613797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-add4150d-29a0-4188-b050-5373ff83ad3f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:21.615627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-add4150d-29a0-4188-b050-5373ff83ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.638450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6939db-c38f-4c9d-8222-ca830f1d3949 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:21.690288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:21.692213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872187e9-ad6d-41d0-8e80-cc300f57da1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:21.692727 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1013/2007] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:21.692838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872187e9-ad6d-41d0-8e80-cc300f57da1b service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.693085 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872187e9-ad6d-41d0-8e80-cc300f57da1b service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.693385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872187e9-ad6d-41d0-8e80-cc300f57da1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.695118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-872187e9-ad6d-41d0-8e80-cc300f57da1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.700325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d3e85-2acc-436c-a5e0-5a61ce7d05de None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.700608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d3e85-2acc-436c-a5e0-5a61ce7d05de None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.701412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d3e85-2acc-436c-a5e0-5a61ce7d05de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.722180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6c2d3e85-2acc-436c-a5e0-5a61ce7d05de None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:21.728403 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6c2d3e85-2acc-436c-a5e0-5a61ce7d05de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.736643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1014/2008] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:21.737751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d3e85-2acc-436c-a5e0-5a61ce7d05de None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:21.749612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d3e85-2acc-436c-a5e0-5a61ce7d05de None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:21.754985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de7fa9-3215-48f8-a7eb-829fc79f9213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:21.755654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de7fa9-3215-48f8-a7eb-829fc79f9213 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.755932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de7fa9-3215-48f8-a7eb-829fc79f9213 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.756202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de7fa9-3215-48f8-a7eb-829fc79f9213 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.756896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de7fa9-3215-48f8-a7eb-829fc79f9213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:21.757199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de7fa9-3215-48f8-a7eb-829fc79f9213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:21.758930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de7fa9-3215-48f8-a7eb-829fc79f9213 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:21.772370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1015/2009] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:21.773881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872187e9-ad6d-41d0-8e80-cc300f57da1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:21.776703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de7fa9-3215-48f8-a7eb-829fc79f9213 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:21.776861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:21.777266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872187e9-ad6d-41d0-8e80-cc300f57da1b service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:21.788975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de7fa9-3215-48f8-a7eb-829fc79f9213 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:21.790008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 995/2010] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:21.791254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872187e9-ad6d-41d0-8e80-cc300f57da1b service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:21.793716 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-872187e9-ad6d-41d0-8e80-cc300f57da1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:21.794198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864b17d-e1ae-4b80-965c-6eef875c1848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:21.794815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864b17d-e1ae-4b80-965c-6eef875c1848 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.795094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864b17d-e1ae-4b80-965c-6eef875c1848 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.795485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864b17d-e1ae-4b80-965c-6eef875c1848 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.796025 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864b17d-e1ae-4b80-965c-6eef875c1848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:21.798752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864b17d-e1ae-4b80-965c-6eef875c1848 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:21.825214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872187e9-ad6d-41d0-8e80-cc300f57da1b service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:21.831242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:21.831886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:21.832166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:21.832434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] PATH_INFO: `/v3/projects/17db4a3366df4417b76b391ba98b0555` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:21.833695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17db4a3366df4417b76b391ba98b0555)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:21.843556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:21.908069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1016/2011] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:21 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:21.909014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864b17d-e1ae-4b80-965c-6eef875c1848 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:21.960876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17db4a3366df4417b76b391ba98b0555', 'request_id': 'req-965f2ef6-f69d-41a6-aeae-313479d1dc63'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:21.967853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17db4a3366df4417b76b391ba98b0555', 'request_id': 'req-965f2ef6-f69d-41a6-aeae-313479d1dc63'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:21.982723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864b17d-e1ae-4b80-965c-6eef875c1848 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:22.043702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0793558-e353-4e93-9b77-544cac411e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:22.044235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0793558-e353-4e93-9b77-544cac411e67 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:22.044511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0793558-e353-4e93-9b77-544cac411e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:22.044784 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0793558-e353-4e93-9b77-544cac411e67 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:22.045481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0793558-e353-4e93-9b77-544cac411e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:22.047391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0793558-e353-4e93-9b77-544cac411e67 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:22.058979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17db4a3366df4417b76b391ba98b0555', 'request_id': 'req-965f2ef6-f69d-41a6-aeae-313479d1dc63'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:22.070623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] The token cache is being invalidate because project 17db4a3366df4417b76b391ba98b0555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:22.070911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:22.071566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:22.073084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 996/2012] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:21 2022] DELETE /identity/v3/projects/17db4a3366df4417b76b391ba98b0555 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:22.073868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:22.075172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:22.132168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f2ef6-f69d-41a6-aeae-313479d1dc63 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:22.135964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0780d3-033e-4010-b226-a28184d35542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:22.136679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0780d3-033e-4010-b226-a28184d35542 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:22.136955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0780d3-033e-4010-b226-a28184d35542 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:22.137224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0780d3-033e-4010-b226-a28184d35542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:22.139050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1e0780d3-033e-4010-b226-a28184d35542 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:22.151403 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1017/2013] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:21 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:22.152692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0793558-e353-4e93-9b77-544cac411e67 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:22.154993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a0793558-e353-4e93-9b77-544cac411e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:22.169002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0793558-e353-4e93-9b77-544cac411e67 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:22.175717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:22.176455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:22.176898 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:22.177265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] PATH_INFO: `/v3/users/b79cf790a52b4319b2e5eeff1ecc7447` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:22.180931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79cf790a52b4319b2e5eeff1ecc7447)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:22.184405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:22.218296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0780d3-033e-4010-b226-a28184d35542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:22.220778 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0780d3-033e-4010-b226-a28184d35542 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:22.236552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 997/2014] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:22.237489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0780d3-033e-4010-b226-a28184d35542 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:22.240024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1e0780d3-033e-4010-b226-a28184d35542 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:22.280092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0780d3-033e-4010-b226-a28184d35542 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:22.289228 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccb3dc-09e9-4d3a-b643-2c20a82ecf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:22.289875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb3dc-09e9-4d3a-b643-2c20a82ecf14 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:22.290153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb3dc-09e9-4d3a-b643-2c20a82ecf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:22.290571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccb3dc-09e9-4d3a-b643-2c20a82ecf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:22.291214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccb3dc-09e9-4d3a-b643-2c20a82ecf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:22.292869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccb3dc-09e9-4d3a-b643-2c20a82ecf14 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:22.321134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 998/2015] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:22.326181 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccb3dc-09e9-4d3a-b643-2c20a82ecf14 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:22.359267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccb3dc-09e9-4d3a-b643-2c20a82ecf14 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:22.376556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988b5bd-7a3f-436e-ab36-4e139b7a70f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:22.377342 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988b5bd-7a3f-436e-ab36-4e139b7a70f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:22.377575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988b5bd-7a3f-436e-ab36-4e139b7a70f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:22.377847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988b5bd-7a3f-436e-ab36-4e139b7a70f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:22.378685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988b5bd-7a3f-436e-ab36-4e139b7a70f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:22.380283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988b5bd-7a3f-436e-ab36-4e139b7a70f8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:22.402669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 999/2016] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:22.448618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988b5bd-7a3f-436e-ab36-4e139b7a70f8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:22.476174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988b5bd-7a3f-436e-ab36-4e139b7a70f8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:22.487402 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcac806-e007-4485-9434-9e2f91608b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:22.490842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcac806-e007-4485-9434-9e2f91608b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:22.494361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcac806-e007-4485-9434-9e2f91608b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:22.496741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcac806-e007-4485-9434-9e2f91608b81 admin admin] PATH_INFO: `/v3/projects/31b69286711c42e7a72e33b57537cb8c/users/b9ce51eda9d5463a88878c6459c52a7d/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:22.503276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79cf790a52b4319b2e5eeff1ecc7447'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:22.552958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcac806-e007-4485-9434-9e2f91608b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b69286711c42e7a72e33b57537cb8c, user_id=b9ce51eda9d5463a88878c6459c52a7d, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:22.553093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79cf790a52b4319b2e5eeff1ecc7447'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:22.553910 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79cf790a52b4319b2e5eeff1ecc7447'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:22.557260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcac806-e007-4485-9434-9e2f91608b81 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:22.565146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79cf790a52b4319b2e5eeff1ecc7447'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:22.584752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:22.647280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79cf790a52b4319b2e5eeff1ecc7447'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:22.664263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1000/2017] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:22 2022] PUT /identity/v3/projects/31b69286711c42e7a72e33b57537cb8c/users/b9ce51eda9d5463a88878c6459c52a7d/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:22.666048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7cfaa-296f-43eb-9ade-aa3ce9566aa8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:22.666048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7cfaa-296f-43eb-9ade-aa3ce9566aa8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:22.666390 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7cfaa-296f-43eb-9ade-aa3ce9566aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:22.675547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1018/2018] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:22 2022] DELETE /identity/v3/users/b79cf790a52b4319b2e5eeff1ecc7447 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:22.720816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c5a7cfaa-296f-43eb-9ade-aa3ce9566aa8 None None] MFA Rules not processed for user `b9ce51eda9d5463a88878c6459c52a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:22.722647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c5a7cfaa-296f-43eb-9ade-aa3ce9566aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:22.838722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1001/2019] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:22.843782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:22.845264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:22.938820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9011a-7cfe-429d-9ab5-ca8a6736c80a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:22.944606 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef0b23-794c-4b6e-86a1-b65f48da241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:22.945353 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef0b23-794c-4b6e-86a1-b65f48da241d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:22.945748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef0b23-794c-4b6e-86a1-b65f48da241d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:22.946088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef0b23-794c-4b6e-86a1-b65f48da241d admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:22.946787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef0b23-794c-4b6e-86a1-b65f48da241d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:22.949757 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef0b23-794c-4b6e-86a1-b65f48da241d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:23.098453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1019/2020] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:22 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:23.103082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7cfaa-296f-43eb-9ade-aa3ce9566aa8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:23.115707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7cfaa-296f-43eb-9ade-aa3ce9566aa8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:23.202445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:23.238807 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722f74b-1bd8-466f-8fa3-07282c3b4212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:23.239663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722f74b-1bd8-466f-8fa3-07282c3b4212 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:23.240193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722f74b-1bd8-466f-8fa3-07282c3b4212 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:23.240582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722f74b-1bd8-466f-8fa3-07282c3b4212 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:23.241266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722f74b-1bd8-466f-8fa3-07282c3b4212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:23.243238 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722f74b-1bd8-466f-8fa3-07282c3b4212 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:23.273154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef0b23-794c-4b6e-86a1-b65f48da241d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:23.276724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-01ef0b23-794c-4b6e-86a1-b65f48da241d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:23.299754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef0b23-794c-4b6e-86a1-b65f48da241d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:23.304596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:23.305232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:23.305643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:23.305921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] PATH_INFO: `/v3/projects/d1ddb1ad267845519e23f48f3dc40e13` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:23.307080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ddb1ad267845519e23f48f3dc40e13)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:23.308983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:23.333845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1002/2021] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:23 2022] POST /identity/v3/users => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:23.337788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722f74b-1bd8-466f-8fa3-07282c3b4212 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:23.347828 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722f74b-1bd8-466f-8fa3-07282c3b4212 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:23.352469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3de02-a98b-4dcb-a26d-3c4c8b49dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:23.353063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3de02-a98b-4dcb-a26d-3c4c8b49dae5 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:23.353370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3de02-a98b-4dcb-a26d-3c4c8b49dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:23.353742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3de02-a98b-4dcb-a26d-3c4c8b49dae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:23.354565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3de02-a98b-4dcb-a26d-3c4c8b49dae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:23.356001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3de02-a98b-4dcb-a26d-3c4c8b49dae5 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:23.372794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1003/2022] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:23.373882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3de02-a98b-4dcb-a26d-3c4c8b49dae5 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:23.386117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3de02-a98b-4dcb-a26d-3c4c8b49dae5 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:23.391408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497ee70-1f38-4803-abad-1de84b074fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:23.392321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497ee70-1f38-4803-abad-1de84b074fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:23.392637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497ee70-1f38-4803-abad-1de84b074fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:23.392965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497ee70-1f38-4803-abad-1de84b074fc5 admin admin] PATH_INFO: `/v3/projects/9e71dcae49e64893b3d6da2606859916/users/b90a2d87798a4ee085a71adab989a54b/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:23.413384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497ee70-1f38-4803-abad-1de84b074fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e71dcae49e64893b3d6da2606859916, user_id=b90a2d87798a4ee085a71adab989a54b, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:23.416040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497ee70-1f38-4803-abad-1de84b074fc5 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:23.430999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ddb1ad267845519e23f48f3dc40e13', 'request_id': 'req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:23.440110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ddb1ad267845519e23f48f3dc40e13', 'request_id': 'req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:23.471218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1004/2023] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:23 2022] PUT /identity/v3/projects/9e71dcae49e64893b3d6da2606859916/users/b90a2d87798a4ee085a71adab989a54b/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:23.475002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497ee70-1f38-4803-abad-1de84b074fc5 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:23.516030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ddb1ad267845519e23f48f3dc40e13', 'request_id': 'req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:23.519109 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:23.536241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] The token cache is being invalidate because project d1ddb1ad267845519e23f48f3dc40e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:23.537360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:23.539076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:23.546533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1020/2024] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:23 2022] DELETE /identity/v3/projects/d1ddb1ad267845519e23f48f3dc40e13 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:23.560524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:23.564001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:23.602106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497ee70-1f38-4803-abad-1de84b074fc5 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:23.627540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419055a-e14f-448c-a9a4-f03c3831aa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:23.628187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419055a-e14f-448c-a9a4-f03c3831aa9b admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:23.628469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419055a-e14f-448c-a9a4-f03c3831aa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:23.628740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419055a-e14f-448c-a9a4-f03c3831aa9b admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:23.631415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419055a-e14f-448c-a9a4-f03c3831aa9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:23.633127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419055a-e14f-448c-a9a4-f03c3831aa9b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:23.644884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1005/2025] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:23.649470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419055a-e14f-448c-a9a4-f03c3831aa9b admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:23.651837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8419055a-e14f-448c-a9a4-f03c3831aa9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:23.667605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419055a-e14f-448c-a9a4-f03c3831aa9b admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:23.670637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d84e5b-8afc-4657-95db-c0d8fb0f3f50 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:23.670765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f210ae-328c-41ff-83e7-21fbfc0f8a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:23.671414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f210ae-328c-41ff-83e7-21fbfc0f8a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:23.671688 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f210ae-328c-41ff-83e7-21fbfc0f8a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:23.673830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f210ae-328c-41ff-83e7-21fbfc0f8a25 admin admin] PATH_INFO: `/v3/projects/9e71dcae49e64893b3d6da2606859916/users/b90a2d87798a4ee085a71adab989a54b/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:23.674455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f210ae-328c-41ff-83e7-21fbfc0f8a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e71dcae49e64893b3d6da2606859916, user_id=b90a2d87798a4ee085a71adab989a54b, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:23.677311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f210ae-328c-41ff-83e7-21fbfc0f8a25 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:23.684860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:23.685681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:23.686094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:23.686414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] PATH_INFO: `/v3/users/2df998fee6ad4217b495613711b6dfcd` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:23.690020 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df998fee6ad4217b495613711b6dfcd)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:23.691265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:23.697652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1006/2026] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:23 2022] PUT /identity/v3/projects/9e71dcae49e64893b3d6da2606859916/users/b90a2d87798a4ee085a71adab989a54b/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:23.700791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1848f46-8f72-4642-9d2a-804a4251e649 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:23.701080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1848f46-8f72-4642-9d2a-804a4251e649 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:23.701389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1848f46-8f72-4642-9d2a-804a4251e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:23.732275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-a1848f46-8f72-4642-9d2a-804a4251e649 None None] MFA Rules not processed for user `b90a2d87798a4ee085a71adab989a54b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:23.733482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a1848f46-8f72-4642-9d2a-804a4251e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:23.831017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1007/2027] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:23.843281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1848f46-8f72-4642-9d2a-804a4251e649 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:23.845507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a1848f46-8f72-4642-9d2a-804a4251e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:23.914102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1848f46-8f72-4642-9d2a-804a4251e649 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:23.917841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27265923-75ab-46b6-b05c-c82cdfe3a072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:23.918443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265923-75ab-46b6-b05c-c82cdfe3a072 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:23.918715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265923-75ab-46b6-b05c-c82cdfe3a072 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:23.918978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27265923-75ab-46b6-b05c-c82cdfe3a072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:23.928710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27265923-75ab-46b6-b05c-c82cdfe3a072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:23.930322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27265923-75ab-46b6-b05c-c82cdfe3a072 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:23.938218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df998fee6ad4217b495613711b6dfcd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:23.942759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1008/2028] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:01:23.952287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df998fee6ad4217b495613711b6dfcd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:23.954133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df998fee6ad4217b495613711b6dfcd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:23.954906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df998fee6ad4217b495613711b6dfcd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:24.025559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df998fee6ad4217b495613711b6dfcd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:24.044080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1021/2029] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:23 2022] DELETE /identity/v3/users/2df998fee6ad4217b495613711b6dfcd => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:24.196635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:24.216677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27265923-75ab-46b6-b05c-c82cdfe3a072 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:24.226262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27265923-75ab-46b6-b05c-c82cdfe3a072 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:24.283734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f18b72-fd55-4344-9ddd-a339dd53ba50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:24.284157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18b72-fd55-4344-9ddd-a339dd53ba50 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:24.284428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18b72-fd55-4344-9ddd-a339dd53ba50 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:24.284754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18b72-fd55-4344-9ddd-a339dd53ba50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:24.287016 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-10f18b72-fd55-4344-9ddd-a339dd53ba50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:24.339143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:24.358418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f18b72-fd55-4344-9ddd-a339dd53ba50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:24.359708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f18b72-fd55-4344-9ddd-a339dd53ba50 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:24.369536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1009/2030] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:25.002367 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:25.014166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:25.016442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:25.155738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b63878-cd9b-4703-b502-9b2f1ae56b6b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:25.170524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:25.171281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:25.173050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:25.175321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] PATH_INFO: `/v3/projects/8ca5aaba03d9480192f4c16d22330ce3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:25.179647 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca5aaba03d9480192f4c16d22330ce3)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:25.181766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:25.311928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca5aaba03d9480192f4c16d22330ce3', 'request_id': 'req-c947acf3-1732-46e6-ad59-9cc9b28087a6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:25.320376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca5aaba03d9480192f4c16d22330ce3', 'request_id': 'req-c947acf3-1732-46e6-ad59-9cc9b28087a6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:25.401855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca5aaba03d9480192f4c16d22330ce3', 'request_id': 'req-c947acf3-1732-46e6-ad59-9cc9b28087a6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:25.414168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] The token cache is being invalidate because project 8ca5aaba03d9480192f4c16d22330ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:25.414833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:25.415574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:25.417166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1022/2031] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:25 2022] DELETE /identity/v3/projects/8ca5aaba03d9480192f4c16d22330ce3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:25.423212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb36dae-b125-4f1b-b61a-56808beb3dc8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:25.424082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb36dae-b125-4f1b-b61a-56808beb3dc8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:25.424590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb36dae-b125-4f1b-b61a-56808beb3dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:25.453975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:25.455163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-cfb36dae-b125-4f1b-b61a-56808beb3dc8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:25.456967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-cfb36dae-b125-4f1b-b61a-56808beb3dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:25.458467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:25.540220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:25.550488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1010/2032] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:25.560464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09822f4b-52a0-42af-b71b-6767b92e81c4 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:25.560464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09822f4b-52a0-42af-b71b-6767b92e81c4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:25.562103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09822f4b-52a0-42af-b71b-6767b92e81c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:25.595278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947acf3-1732-46e6-ad59-9cc9b28087a6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:25.599056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-09822f4b-52a0-42af-b71b-6767b92e81c4 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:25.600375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-09822f4b-52a0-42af-b71b-6767b92e81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:25.600826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:25.601659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:25.601931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:25.602198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] PATH_INFO: `/v3/users/b9ce51eda9d5463a88878c6459c52a7d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:25.603638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ce51eda9d5463a88878c6459c52a7d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:25.605591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:25.609984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1011/2033] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:25.614057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09822f4b-52a0-42af-b71b-6767b92e81c4 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:25.630043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09822f4b-52a0-42af-b71b-6767b92e81c4 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:25.639444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bca19-e9bc-4de1-9c6c-7c29e5755d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:25.640356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bca19-e9bc-4de1-9c6c-7c29e5755d74 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:25.640632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bca19-e9bc-4de1-9c6c-7c29e5755d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:25.640903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bca19-e9bc-4de1-9c6c-7c29e5755d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:25.642246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bca19-e9bc-4de1-9c6c-7c29e5755d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:25.642474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bca19-e9bc-4de1-9c6c-7c29e5755d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:25.642585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:25.644317 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bca19-e9bc-4de1-9c6c-7c29e5755d74 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:25.657382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1012/2034] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:25.661768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bca19-e9bc-4de1-9c6c-7c29e5755d74 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:25.671855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bca19-e9bc-4de1-9c6c-7c29e5755d74 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:25.676891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bad7a8-5eac-4f87-83d8-859449f4c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:25.677525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bad7a8-5eac-4f87-83d8-859449f4c417 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:25.677800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bad7a8-5eac-4f87-83d8-859449f4c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:25.678067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bad7a8-5eac-4f87-83d8-859449f4c417 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:25.679058 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bad7a8-5eac-4f87-83d8-859449f4c417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:25.680890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bad7a8-5eac-4f87-83d8-859449f4c417 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:25.772183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1013/2035] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:25 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:25.773164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bad7a8-5eac-4f87-83d8-859449f4c417 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:25.798865 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ce51eda9d5463a88878c6459c52a7d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:25.819715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ce51eda9d5463a88878c6459c52a7d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:25.821483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ce51eda9d5463a88878c6459c52a7d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:25.822601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ce51eda9d5463a88878c6459c52a7d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:25.867472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bad7a8-5eac-4f87-83d8-859449f4c417 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:25.872452 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332a9e3-cbd2-4ca9-9760-7c25826b721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:25.873461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332a9e3-cbd2-4ca9-9760-7c25826b721e admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:25.873461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332a9e3-cbd2-4ca9-9760-7c25826b721e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:25.873890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332a9e3-cbd2-4ca9-9760-7c25826b721e admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:25.874755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332a9e3-cbd2-4ca9-9760-7c25826b721e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:25.877497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332a9e3-cbd2-4ca9-9760-7c25826b721e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:25.916374 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-74dfbe61-a8c1-4bf5-a96b-8b003637628d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ce51eda9d5463a88878c6459c52a7d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:25.930760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1023/2036] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:25 2022] DELETE /identity/v3/users/b9ce51eda9d5463a88878c6459c52a7d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:25.934973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c58c8-2098-4b6d-83b5-ba9e007db5a7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:25.935368 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c58c8-2098-4b6d-83b5-ba9e007db5a7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:25.935725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c58c8-2098-4b6d-83b5-ba9e007db5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:25.956525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9f1c58c8-2098-4b6d-83b5-ba9e007db5a7 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:25.957910 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9f1c58c8-2098-4b6d-83b5-ba9e007db5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:26.017564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1014/2037] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:25 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:26.021938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332a9e3-cbd2-4ca9-9760-7c25826b721e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:26.026588 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5332a9e3-cbd2-4ca9-9760-7c25826b721e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:26.048488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332a9e3-cbd2-4ca9-9760-7c25826b721e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:26.072388 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1024/2038] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:26.083297 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c58c8-2098-4b6d-83b5-ba9e007db5a7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:26.084830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9f1c58c8-2098-4b6d-83b5-ba9e007db5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:26.169696 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125d7ad-01f5-4640-aef1-20e7ddb63232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:26.170206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125d7ad-01f5-4640-aef1-20e7ddb63232 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:26.170553 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125d7ad-01f5-4640-aef1-20e7ddb63232 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:26.170891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125d7ad-01f5-4640-aef1-20e7ddb63232 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:26.173851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125d7ad-01f5-4640-aef1-20e7ddb63232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:26.175581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125d7ad-01f5-4640-aef1-20e7ddb63232 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:26.189234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1015/2039] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:26.193283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125d7ad-01f5-4640-aef1-20e7ddb63232 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:26.193843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c58c8-2098-4b6d-83b5-ba9e007db5a7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:26.195788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7125d7ad-01f5-4640-aef1-20e7ddb63232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:26.201003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821209f-6175-4e14-a222-2883dd2bec52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:26.201722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821209f-6175-4e14-a222-2883dd2bec52 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:26.202067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821209f-6175-4e14-a222-2883dd2bec52 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:26.202408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821209f-6175-4e14-a222-2883dd2bec52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:26.211003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125d7ad-01f5-4640-aef1-20e7ddb63232 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:26.212597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821209f-6175-4e14-a222-2883dd2bec52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:26.214441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821209f-6175-4e14-a222-2883dd2bec52 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:26.217990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:26.219431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:26.219431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:26.219635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] PATH_INFO: `/v3/users/306bc54e284c4d908e591dd94fbbe591` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:26.220822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=306bc54e284c4d908e591dd94fbbe591)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:26.222937 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:26.228535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1025/2040] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:26.229602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821209f-6175-4e14-a222-2883dd2bec52 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:26.257191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821209f-6175-4e14-a222-2883dd2bec52 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:26.263756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739f3ea-108b-44f8-93a9-3cceef28d66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:26.264705 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739f3ea-108b-44f8-93a9-3cceef28d66f admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:26.265172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739f3ea-108b-44f8-93a9-3cceef28d66f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:26.265650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739f3ea-108b-44f8-93a9-3cceef28d66f admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:26.266499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739f3ea-108b-44f8-93a9-3cceef28d66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:26.268351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739f3ea-108b-44f8-93a9-3cceef28d66f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:26.280125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1026/2041] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:26.284532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739f3ea-108b-44f8-93a9-3cceef28d66f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:26.304238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739f3ea-108b-44f8-93a9-3cceef28d66f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:26.318292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb09ed-e236-4afe-a743-26044841a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:26.319679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb09ed-e236-4afe-a743-26044841a329 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:26.319974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb09ed-e236-4afe-a743-26044841a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:26.320252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb09ed-e236-4afe-a743-26044841a329 admin admin] PATH_INFO: `/v3/projects/5d39b15640bc4194a358c4c54f7f36d7/users/ce4f7936bd034eb99d15c1460190ba44/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:26.341782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb09ed-e236-4afe-a743-26044841a329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d39b15640bc4194a358c4c54f7f36d7, user_id=ce4f7936bd034eb99d15c1460190ba44, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:26.345864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb09ed-e236-4afe-a743-26044841a329 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:26.417554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:26.444652 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1027/2042] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:26 2022] PUT /identity/v3/projects/5d39b15640bc4194a358c4c54f7f36d7/users/ce4f7936bd034eb99d15c1460190ba44/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:26.449779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ef11a-7831-4e61-819f-8c907a946781 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:26.450264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ef11a-7831-4e61-819f-8c907a946781 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:26.450685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ef11a-7831-4e61-819f-8c907a946781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:26.486460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306bc54e284c4d908e591dd94fbbe591'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:26.496673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-397ef11a-7831-4e61-819f-8c907a946781 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:26.497932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-397ef11a-7831-4e61-819f-8c907a946781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:26.503611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306bc54e284c4d908e591dd94fbbe591'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:26.535816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306bc54e284c4d908e591dd94fbbe591'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:26.538622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306bc54e284c4d908e591dd94fbbe591'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:26.540777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ddd47c7a-dc78-4a1c-860e-3bbdeade4272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306bc54e284c4d908e591dd94fbbe591'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:26.590344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:26.616585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1028/2043] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:26.638863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ef11a-7831-4e61-819f-8c907a946781 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:26.645639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-397ef11a-7831-4e61-819f-8c907a946781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:26.667713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1016/2044] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:26 2022] DELETE /identity/v3/users/306bc54e284c4d908e591dd94fbbe591 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:26.669691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5c909-ae5b-4c94-9b08-de2d5c7790e8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:26.670008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5c909-ae5b-4c94-9b08-de2d5c7790e8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:26.670541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5c909-ae5b-4c94-9b08-de2d5c7790e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:26.698243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c4a5c909-ae5b-4c94-9b08-de2d5c7790e8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:26.700867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c4a5c909-ae5b-4c94-9b08-de2d5c7790e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:26.759619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ef11a-7831-4e61-819f-8c907a946781 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:26.814614 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1017/2045] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:26.829487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5c909-ae5b-4c94-9b08-de2d5c7790e8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:26.857277 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dcf29-6136-41ac-9ebc-1c28fa9a585f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:26.858592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dcf29-6136-41ac-9ebc-1c28fa9a585f service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:26.859042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dcf29-6136-41ac-9ebc-1c28fa9a585f service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:26.859455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dcf29-6136-41ac-9ebc-1c28fa9a585f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:26.876993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dcf29-6136-41ac-9ebc-1c28fa9a585f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:26.887213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dcf29-6136-41ac-9ebc-1c28fa9a585f service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:26.904136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1029/2046] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:26.913350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5c909-ae5b-4c94-9b08-de2d5c7790e8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:26.925692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550e4d3-495c-44ec-81f1-055a65f96acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:26.925692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550e4d3-495c-44ec-81f1-055a65f96acf service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:26.925692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550e4d3-495c-44ec-81f1-055a65f96acf service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:26.925692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550e4d3-495c-44ec-81f1-055a65f96acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:26.930452 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550e4d3-495c-44ec-81f1-055a65f96acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:26.932055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550e4d3-495c-44ec-81f1-055a65f96acf service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:26.945657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1018/2047] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:26.980070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dcf29-6136-41ac-9ebc-1c28fa9a585f service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:26.981622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-778dcf29-6136-41ac-9ebc-1c28fa9a585f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:27.010802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dcf29-6136-41ac-9ebc-1c28fa9a585f service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:27.046441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:27.048314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:27.048314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:27.048314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] PATH_INFO: `/v3/projects/31b69286711c42e7a72e33b57537cb8c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:27.054970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b69286711c42e7a72e33b57537cb8c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:27.057202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:27.210891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b69286711c42e7a72e33b57537cb8c', 'request_id': 'req-7a629eaa-c156-4739-bb2c-4e09fac07283'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:27.219695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b69286711c42e7a72e33b57537cb8c', 'request_id': 'req-7a629eaa-c156-4739-bb2c-4e09fac07283'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:27.226112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:27.350549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b69286711c42e7a72e33b57537cb8c', 'request_id': 'req-7a629eaa-c156-4739-bb2c-4e09fac07283'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:27.372038 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] The token cache is being invalidate because project 31b69286711c42e7a72e33b57537cb8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:27.372662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:27.373867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:27.379742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1030/2048] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:26 2022] DELETE /identity/v3/projects/31b69286711c42e7a72e33b57537cb8c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:27.383901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550e4d3-495c-44ec-81f1-055a65f96acf service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:27.418809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550e4d3-495c-44ec-81f1-055a65f96acf service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:27.513599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:27.515570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:27.517136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:27.517853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] PATH_INFO: `/v3/users/b90a2d87798a4ee085a71adab989a54b` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:27.521144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90a2d87798a4ee085a71adab989a54b)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:27.524520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:27.695546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90a2d87798a4ee085a71adab989a54b'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:27.707768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90a2d87798a4ee085a71adab989a54b'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:27.725539 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90a2d87798a4ee085a71adab989a54b'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:27.726473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90a2d87798a4ee085a71adab989a54b'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:27.727144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90a2d87798a4ee085a71adab989a54b'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:27.805448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1019/2049] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:27 2022] DELETE /identity/v3/users/b90a2d87798a4ee085a71adab989a54b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:27.842909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:28.009410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:28.010860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:28.032739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a629eaa-c156-4739-bb2c-4e09fac07283 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:28.144977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:28.145684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:28.145952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:28.146218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] PATH_INFO: `/v3/projects/9a630fb8707643ee8d7dee2226ee7d9b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:28.151303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a630fb8707643ee8d7dee2226ee7d9b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:28.151303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:28.186063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:28.274976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a630fb8707643ee8d7dee2226ee7d9b', 'request_id': 'req-52142cee-c17e-4e4b-a344-1db5e144d01f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.290247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a630fb8707643ee8d7dee2226ee7d9b', 'request_id': 'req-52142cee-c17e-4e4b-a344-1db5e144d01f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.290528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:28.292126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:28.307740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1dc56f-7a17-4f4e-929f-8ebe7333d876 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:28.366902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a630fb8707643ee8d7dee2226ee7d9b', 'request_id': 'req-52142cee-c17e-4e4b-a344-1db5e144d01f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.369659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:28.370387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:28.370738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:28.371090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] PATH_INFO: `/v3/users/b1e7b39248ef4a8ba7f3ebf5df1372ea` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:28.372675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e7b39248ef4a8ba7f3ebf5df1372ea)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:28.374791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:28.383600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] The token cache is being invalidate because project 9a630fb8707643ee8d7dee2226ee7d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:28.383975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.384693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.386671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1031/2050] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:28 2022] DELETE /identity/v3/projects/9a630fb8707643ee8d7dee2226ee7d9b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:28.390426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:28.391884 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:28.404970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52142cee-c17e-4e4b-a344-1db5e144d01f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:28.410184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:28.410868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:28.411147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:28.412553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] PATH_INFO: `/v3/users/f661bca5a4a149a98c266842efc67563` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:28.412663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f661bca5a4a149a98c266842efc67563)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:28.414660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:28.589257 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e7b39248ef4a8ba7f3ebf5df1372ea'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.623671 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e7b39248ef4a8ba7f3ebf5df1372ea'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.637160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f661bca5a4a149a98c266842efc67563'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.649997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e7b39248ef4a8ba7f3ebf5df1372ea'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.651533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e7b39248ef4a8ba7f3ebf5df1372ea'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.652207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e7b39248ef4a8ba7f3ebf5df1372ea'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.659616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f661bca5a4a149a98c266842efc67563'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.659616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f661bca5a4a149a98c266842efc67563'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.659616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f661bca5a4a149a98c266842efc67563'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.740647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:28.746172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1020/2051] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:28 2022] DELETE /identity/v3/users/b1e7b39248ef4a8ba7f3ebf5df1372ea => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:28.747007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:28.749611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:28.823263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbb47e-6706-482c-ba00-c2f733f60222 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:28.824297 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-76e94a2b-a530-4495-b343-1e47ef82ec32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f661bca5a4a149a98c266842efc67563'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:28.827953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:28.828699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:28.828964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:28.829233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] PATH_INFO: `/v3/projects/9e71dcae49e64893b3d6da2606859916` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:28.830411 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e71dcae49e64893b3d6da2606859916)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:28.832494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:28.845649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1032/2052] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:28 2022] DELETE /identity/v3/users/f661bca5a4a149a98c266842efc67563 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:28.849716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ee80-1fc7-4c60-9766-af477cc2b9fb None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:28.849998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ee80-1fc7-4c60-9766-af477cc2b9fb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:28.850270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ee80-1fc7-4c60-9766-af477cc2b9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:28.892533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d4d5ee80-1fc7-4c60-9766-af477cc2b9fb None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:28.896723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d4d5ee80-1fc7-4c60-9766-af477cc2b9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:28.961607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1033/2053] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:28.991243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ee80-1fc7-4c60-9766-af477cc2b9fb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:28.992810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d4d5ee80-1fc7-4c60-9766-af477cc2b9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:29.029963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e71dcae49e64893b3d6da2606859916', 'request_id': 'req-bde4780c-7e96-4183-8d5d-5b5660de19e6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:29.038606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e71dcae49e64893b3d6da2606859916', 'request_id': 'req-bde4780c-7e96-4183-8d5d-5b5660de19e6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:29.087487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ee80-1fc7-4c60-9766-af477cc2b9fb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:29.132915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e71dcae49e64893b3d6da2606859916', 'request_id': 'req-bde4780c-7e96-4183-8d5d-5b5660de19e6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:29.152100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] The token cache is being invalidate because project 9e71dcae49e64893b3d6da2606859916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:29.152421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:29.154455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-bde4780c-7e96-4183-8d5d-5b5660de19e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:29.157171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27afb0-10a9-4159-9ad2-fb7fd3f33e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:29.158052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27afb0-10a9-4159-9ad2-fb7fd3f33e55 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.158565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27afb0-10a9-4159-9ad2-fb7fd3f33e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.159288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27afb0-10a9-4159-9ad2-fb7fd3f33e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.160350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1021/2054] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:28 2022] DELETE /identity/v3/projects/9e71dcae49e64893b3d6da2606859916 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:29.167294 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea14bc0-6bc1-4603-a2bb-1db998073262 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.167294 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea14bc0-6bc1-4603-a2bb-1db998073262 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.167294 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea14bc0-6bc1-4603-a2bb-1db998073262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.167513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1b27afb0-10a9-4159-9ad2-fb7fd3f33e55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:29.204937 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-bea14bc0-6bc1-4603-a2bb-1db998073262 None None] MFA Rules not processed for user `ce4f7936bd034eb99d15c1460190ba44`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:29.208631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bea14bc0-6bc1-4603-a2bb-1db998073262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:29.248683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27afb0-10a9-4159-9ad2-fb7fd3f33e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:29.250856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27afb0-10a9-4159-9ad2-fb7fd3f33e55 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:29.265319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1034/2055] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:01:29.267599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f927a3b-c43c-4a01-96a9-c33f383708e3 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.267952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f927a3b-c43c-4a01-96a9-c33f383708e3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.268950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f927a3b-c43c-4a01-96a9-c33f383708e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.296162 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7f927a3b-c43c-4a01-96a9-c33f383708e3 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:29.299224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7f927a3b-c43c-4a01-96a9-c33f383708e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:29.309882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1035/2056] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:29.315783 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1022/2057] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:29.319511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389db45e-3f73-4274-a8e4-816c935021de None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.319511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389db45e-3f73-4274-a8e4-816c935021de None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.319684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389db45e-3f73-4274-a8e4-816c935021de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.326017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea14bc0-6bc1-4603-a2bb-1db998073262 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:29.327551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bea14bc0-6bc1-4603-a2bb-1db998073262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:29.340924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-389db45e-3f73-4274-a8e4-816c935021de None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:29.340924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-389db45e-3f73-4274-a8e4-816c935021de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:29.350069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1036/2058] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:29.353895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389db45e-3f73-4274-a8e4-816c935021de None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:29.363142 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389db45e-3f73-4274-a8e4-816c935021de None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:29.370438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f66378-0308-4fd7-9087-8331d8f71df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:29.371838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66378-0308-4fd7-9087-8331d8f71df7 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.373792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66378-0308-4fd7-9087-8331d8f71df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.373792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66378-0308-4fd7-9087-8331d8f71df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.373792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f66378-0308-4fd7-9087-8331d8f71df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:29.374065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f66378-0308-4fd7-9087-8331d8f71df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:29.375753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f66378-0308-4fd7-9087-8331d8f71df7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:29.395961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1037/2059] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:01:29.396206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:29.399571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f66378-0308-4fd7-9087-8331d8f71df7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:29.399692 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea14bc0-6bc1-4603-a2bb-1db998073262 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:29.399774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-25f66378-0308-4fd7-9087-8331d8f71df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:29.404583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84561bfe-fa76-46cf-9c0e-0b1c3a541866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:29.405335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84561bfe-fa76-46cf-9c0e-0b1c3a541866 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.408989 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84561bfe-fa76-46cf-9c0e-0b1c3a541866 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.408989 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84561bfe-fa76-46cf-9c0e-0b1c3a541866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.414861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f66378-0308-4fd7-9087-8331d8f71df7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:29.425693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:29.431240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.431240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.431425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84561bfe-fa76-46cf-9c0e-0b1c3a541866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:29.431522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] PATH_INFO: `/v3/projects/d244d89c7a304e508ba12fc36ae01da9` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.431522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d244d89c7a304e508ba12fc36ae01da9)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:29.431664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84561bfe-fa76-46cf-9c0e-0b1c3a541866 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:29.431738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:29.447505 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1023/2060] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:01:29.448459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84561bfe-fa76-46cf-9c0e-0b1c3a541866 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:29.470518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84561bfe-fa76-46cf-9c0e-0b1c3a541866 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:29.470518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33191ccb-05ac-424c-a534-5fa5e97a0b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:29.470518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33191ccb-05ac-424c-a534-5fa5e97a0b23 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.470518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33191ccb-05ac-424c-a534-5fa5e97a0b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.471092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33191ccb-05ac-424c-a534-5fa5e97a0b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.471092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33191ccb-05ac-424c-a534-5fa5e97a0b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:29.472695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33191ccb-05ac-424c-a534-5fa5e97a0b23 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:29.561330 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1024/2061] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:29 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:29.563670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33191ccb-05ac-424c-a534-5fa5e97a0b23 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:29.590453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd244d89c7a304e508ba12fc36ae01da9', 'request_id': 'req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:29.598703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd244d89c7a304e508ba12fc36ae01da9', 'request_id': 'req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:29.647671 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33191ccb-05ac-424c-a534-5fa5e97a0b23 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:29.652856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632632c1-3d72-41f1-9eac-abffd77b8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:29.653579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632632c1-3d72-41f1-9eac-abffd77b8f55 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.654077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632632c1-3d72-41f1-9eac-abffd77b8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.654350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632632c1-3d72-41f1-9eac-abffd77b8f55 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.654981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632632c1-3d72-41f1-9eac-abffd77b8f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:29.658197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd244d89c7a304e508ba12fc36ae01da9', 'request_id': 'req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:29.660400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632632c1-3d72-41f1-9eac-abffd77b8f55 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:29.673213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] The token cache is being invalidate because project d244d89c7a304e508ba12fc36ae01da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:29.673557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:29.677864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:29.679648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1038/2062] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:29 2022] DELETE /identity/v3/projects/d244d89c7a304e508ba12fc36ae01da9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:29.686281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:29.686281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:29.765516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be04b69-a625-4f86-ba2a-6d85f4cac9ae admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:29.768569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1025/2063] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:29 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:29.773931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:29.774509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.774734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632632c1-3d72-41f1-9eac-abffd77b8f55 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:29.774873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.775471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] PATH_INFO: `/v3/users/de1aebc610ce40298b525f622086c1da` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.776656 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-632632c1-3d72-41f1-9eac-abffd77b8f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:29.777212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de1aebc610ce40298b525f622086c1da)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:29.779376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:29.792630 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632632c1-3d72-41f1-9eac-abffd77b8f55 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:29.802450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812382d1-3a7a-4535-8391-85482662e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:29.803465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812382d1-3a7a-4535-8391-85482662e900 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.803579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812382d1-3a7a-4535-8391-85482662e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.803790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812382d1-3a7a-4535-8391-85482662e900 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.804516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812382d1-3a7a-4535-8391-85482662e900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:29.806729 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812382d1-3a7a-4535-8391-85482662e900 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:29.825350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1026/2064] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:29.826518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812382d1-3a7a-4535-8391-85482662e900 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:29.829058 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-812382d1-3a7a-4535-8391-85482662e900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:29.839866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:29.843935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812382d1-3a7a-4535-8391-85482662e900 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:29.850561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:29.851281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:29.851792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:29.852244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] PATH_INFO: `/v3/projects/d663d479996643c598e3da0011ed05ad` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:29.854414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d663d479996643c598e3da0011ed05ad)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:29.857232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:30.030843 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd663d479996643c598e3da0011ed05ad', 'request_id': 'req-eabdd2b7-0b7c-4302-8929-fd5113658c1d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.034862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de1aebc610ce40298b525f622086c1da'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.048419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de1aebc610ce40298b525f622086c1da'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.048695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd663d479996643c598e3da0011ed05ad', 'request_id': 'req-eabdd2b7-0b7c-4302-8929-fd5113658c1d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.049978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de1aebc610ce40298b525f622086c1da'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.051209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de1aebc610ce40298b525f622086c1da'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.121176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd663d479996643c598e3da0011ed05ad', 'request_id': 'req-eabdd2b7-0b7c-4302-8929-fd5113658c1d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.142043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] The token cache is being invalidate because project d663d479996643c598e3da0011ed05ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:30.142777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.143229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.147985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1027/2065] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:29 2022] DELETE /identity/v3/projects/d663d479996643c598e3da0011ed05ad => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:30.147985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:30.148875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:30.200921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de1aebc610ce40298b525f622086c1da'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.214664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1039/2066] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:29 2022] DELETE /identity/v3/users/de1aebc610ce40298b525f622086c1da => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:30.216192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:30.218714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:30.226420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdd2b7-0b7c-4302-8929-fd5113658c1d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:30.294898 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017205c7-a58a-4fde-94a1-2345cdd0a6d2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:30.322123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228fb97-01b8-4515-bec1-d4817cc841a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:30.322944 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fb97-01b8-4515-bec1-d4817cc841a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:30.323395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fb97-01b8-4515-bec1-d4817cc841a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:30.323910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228fb97-01b8-4515-bec1-d4817cc841a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:30.325036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228fb97-01b8-4515-bec1-d4817cc841a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:30.326972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228fb97-01b8-4515-bec1-d4817cc841a2 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:30.334320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:30.335562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:30.336071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:30.336594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] PATH_INFO: `/v3/users/e168307fb907439d89f999ca1d3ded2a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:30.340660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e168307fb907439d89f999ca1d3ded2a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:30.343166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:30.347457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1028/2067] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:30.348733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228fb97-01b8-4515-bec1-d4817cc841a2 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:30.366112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228fb97-01b8-4515-bec1-d4817cc841a2 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:30.383155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a0fcb-2adb-45ec-bf28-aeebe09940fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:30.384987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0fcb-2adb-45ec-bf28-aeebe09940fc admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:30.385619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0fcb-2adb-45ec-bf28-aeebe09940fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:30.386722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0fcb-2adb-45ec-bf28-aeebe09940fc admin admin] PATH_INFO: `/v3/projects/cee27d39de1a43d09de7d8ce0ce221c4/users/3b63561933c14c05bfc5689779574777/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:30.425642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a0fcb-2adb-45ec-bf28-aeebe09940fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee27d39de1a43d09de7d8ce0ce221c4, user_id=3b63561933c14c05bfc5689779574777, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:30.425642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a0fcb-2adb-45ec-bf28-aeebe09940fc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:30.488844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1029/2068] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:30 2022] PUT /identity/v3/projects/cee27d39de1a43d09de7d8ce0ce221c4/users/3b63561933c14c05bfc5689779574777/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:30.499493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32972662-dd2c-4f0d-8ea9-2877335f602a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:30.499772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32972662-dd2c-4f0d-8ea9-2877335f602a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:30.500038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32972662-dd2c-4f0d-8ea9-2877335f602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:30.537495 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-32972662-dd2c-4f0d-8ea9-2877335f602a None None] MFA Rules not processed for user `3b63561933c14c05bfc5689779574777`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:30.538681 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-32972662-dd2c-4f0d-8ea9-2877335f602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:30.567906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:30.569708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e168307fb907439d89f999ca1d3ded2a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.583568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e168307fb907439d89f999ca1d3ded2a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.584324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e168307fb907439d89f999ca1d3ded2a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.584982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e168307fb907439d89f999ca1d3ded2a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.637261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1030/2069] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:30.647578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e168307fb907439d89f999ca1d3ded2a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:30.647784 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32972662-dd2c-4f0d-8ea9-2877335f602a None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:30.649594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-32972662-dd2c-4f0d-8ea9-2877335f602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:30.664337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1040/2070] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:30 2022] DELETE /identity/v3/users/e168307fb907439d89f999ca1d3ded2a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:30.734510 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32972662-dd2c-4f0d-8ea9-2877335f602a None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:30.805456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919406f-c69c-40d0-adf1-c07015d0085b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:30.806483 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919406f-c69c-40d0-adf1-c07015d0085b service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:30.807130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919406f-c69c-40d0-adf1-c07015d0085b service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:30.807520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919406f-c69c-40d0-adf1-c07015d0085b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:30.889070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919406f-c69c-40d0-adf1-c07015d0085b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:30.891807 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919406f-c69c-40d0-adf1-c07015d0085b service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:30.904765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1031/2071] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:01:30.962137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:31.323938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:31.323938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:31.506385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8ceb3-f011-410b-a833-519e5b673c08 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:31.506385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:31.506385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:31.506385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:31.507808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] PATH_INFO: `/v3/projects/142360831fac4814954676f85fa8c429` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:31.507808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142360831fac4814954676f85fa8c429)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:31.507808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:31.771569 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142360831fac4814954676f85fa8c429', 'request_id': 'req-3a912801-48f2-47fa-a889-74c494e0f106'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:31.777738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142360831fac4814954676f85fa8c429', 'request_id': 'req-3a912801-48f2-47fa-a889-74c494e0f106'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:32.018562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142360831fac4814954676f85fa8c429', 'request_id': 'req-3a912801-48f2-47fa-a889-74c494e0f106'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:32.030333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] The token cache is being invalidate because project 142360831fac4814954676f85fa8c429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:32.030615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:32.031242 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:32.033256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1041/2072] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:31 2022] DELETE /identity/v3/projects/142360831fac4814954676f85fa8c429 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:32.040010 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06cc2a-a616-4dce-b850-1f7a5140513e None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.040490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06cc2a-a616-4dce-b850-1f7a5140513e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.040585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06cc2a-a616-4dce-b850-1f7a5140513e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.055651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.057283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:32.080881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9b06cc2a-a616-4dce-b850-1f7a5140513e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:32.080881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9b06cc2a-a616-4dce-b850-1f7a5140513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:32.134189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a912801-48f2-47fa-a889-74c494e0f106 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.139265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1032/2073] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:32.139411 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.139840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.140114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.140542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] PATH_INFO: `/v3/projects/683a79f00337464bbbb75adc3a83b37c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.142429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] RBAC: Authorizing `identity:delete_project(project_id=683a79f00337464bbbb75adc3a83b37c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.144352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.147922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620df4e-7674-4a39-96b0-f0a3d82fe96e None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.153362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620df4e-7674-4a39-96b0-f0a3d82fe96e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.153362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620df4e-7674-4a39-96b0-f0a3d82fe96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.169702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-8620df4e-7674-4a39-96b0-f0a3d82fe96e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:32.170929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8620df4e-7674-4a39-96b0-f0a3d82fe96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:32.180526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1033/2074] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:32.184736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620df4e-7674-4a39-96b0-f0a3d82fe96e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.193789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620df4e-7674-4a39-96b0-f0a3d82fe96e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.198584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437fb92-ef07-4fe6-9b77-51c9245227e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.199164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437fb92-ef07-4fe6-9b77-51c9245227e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.199437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437fb92-ef07-4fe6-9b77-51c9245227e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.199705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437fb92-ef07-4fe6-9b77-51c9245227e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.200338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437fb92-ef07-4fe6-9b77-51c9245227e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:32.200689 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437fb92-ef07-4fe6-9b77-51c9245227e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.205664 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437fb92-ef07-4fe6-9b77-51c9245227e2 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.220570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1034/2075] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:01:32.224924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437fb92-ef07-4fe6-9b77-51c9245227e2 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.235221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437fb92-ef07-4fe6-9b77-51c9245227e2 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.239940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca8bc-4cf2-4e38-9d3d-c0e89f4dca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.244138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca8bc-4cf2-4e38-9d3d-c0e89f4dca18 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.244138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca8bc-4cf2-4e38-9d3d-c0e89f4dca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.244138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca8bc-4cf2-4e38-9d3d-c0e89f4dca18 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.244138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ca8bc-4cf2-4e38-9d3d-c0e89f4dca18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.244138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ca8bc-4cf2-4e38-9d3d-c0e89f4dca18 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.283520 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683a79f00337464bbbb75adc3a83b37c', 'request_id': 'req-4fc7c2b8-a677-499f-a686-508aef57572a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:32.290136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683a79f00337464bbbb75adc3a83b37c', 'request_id': 'req-4fc7c2b8-a677-499f-a686-508aef57572a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:32.352946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1035/2076] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:32 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:32.356269 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca8bc-4cf2-4e38-9d3d-c0e89f4dca18 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.372466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683a79f00337464bbbb75adc3a83b37c', 'request_id': 'req-4fc7c2b8-a677-499f-a686-508aef57572a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:32.375033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:32.385280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] The token cache is being invalidate because project 683a79f00337464bbbb75adc3a83b37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:32.385645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:32.386260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4fc7c2b8-a677-499f-a686-508aef57572a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:32.387971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1042/2077] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:32 2022] DELETE /identity/v3/projects/683a79f00337464bbbb75adc3a83b37c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:32.392979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352d234-7db9-49fe-843f-ca3281f39e88 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.393159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352d234-7db9-49fe-843f-ca3281f39e88 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.393637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352d234-7db9-49fe-843f-ca3281f39e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.413709 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1352d234-7db9-49fe-843f-ca3281f39e88 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:32.414914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1352d234-7db9-49fe-843f-ca3281f39e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:32.421858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca8bc-4cf2-4e38-9d3d-c0e89f4dca18 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.425219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1043/2078] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:32.426946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27bf5d-891d-4cc5-9431-6da1e1078aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.427548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bf5d-891d-4cc5-9431-6da1e1078aca admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.427936 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bf5d-891d-4cc5-9431-6da1e1078aca admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.428122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bf5d-891d-4cc5-9431-6da1e1078aca admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.428771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27bf5d-891d-4cc5-9431-6da1e1078aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.431665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27bf5d-891d-4cc5-9431-6da1e1078aca admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.433639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b986a-3f64-454f-a32c-01961dc98d84 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.434165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b986a-3f64-454f-a32c-01961dc98d84 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.434649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b986a-3f64-454f-a32c-01961dc98d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.457044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-465b986a-3f64-454f-a32c-01961dc98d84 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:32.458820 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-465b986a-3f64-454f-a32c-01961dc98d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:32.470889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1044/2079] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:32.475677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b986a-3f64-454f-a32c-01961dc98d84 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.485111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b986a-3f64-454f-a32c-01961dc98d84 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.489957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76198b36-9078-4c57-a088-305f6bdb48a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.490544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76198b36-9078-4c57-a088-305f6bdb48a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.490901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76198b36-9078-4c57-a088-305f6bdb48a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.491249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76198b36-9078-4c57-a088-305f6bdb48a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.492479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76198b36-9078-4c57-a088-305f6bdb48a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:32.492607 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76198b36-9078-4c57-a088-305f6bdb48a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.494110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76198b36-9078-4c57-a088-305f6bdb48a0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.502696 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1036/2080] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:32 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:32.504138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27bf5d-891d-4cc5-9431-6da1e1078aca admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.506187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4f27bf5d-891d-4cc5-9431-6da1e1078aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:32.510210 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1045/2081] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:32.514251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76198b36-9078-4c57-a088-305f6bdb48a0 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.529648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27bf5d-891d-4cc5-9431-6da1e1078aca admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.529816 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76198b36-9078-4c57-a088-305f6bdb48a0 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.537120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8626fe-e423-48ac-a733-22d360232a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.538560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8626fe-e423-48ac-a733-22d360232a85 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.538844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8626fe-e423-48ac-a733-22d360232a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.539300 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8626fe-e423-48ac-a733-22d360232a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.539966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8626fe-e423-48ac-a733-22d360232a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.542099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8626fe-e423-48ac-a733-22d360232a85 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.554420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0cb31-2aa5-4c25-be17-903cb5acadb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.555054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0cb31-2aa5-4c25-be17-903cb5acadb8 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.555333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0cb31-2aa5-4c25-be17-903cb5acadb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.555605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0cb31-2aa5-4c25-be17-903cb5acadb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.559524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0cb31-2aa5-4c25-be17-903cb5acadb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.562773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0cb31-2aa5-4c25-be17-903cb5acadb8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.584533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1037/2082] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:32.588559 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0cb31-2aa5-4c25-be17-903cb5acadb8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.601523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0cb31-2aa5-4c25-be17-903cb5acadb8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.606591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd0f97-c0bc-460d-9153-daa7dd74f052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.607275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd0f97-c0bc-460d-9153-daa7dd74f052 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.607551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd0f97-c0bc-460d-9153-daa7dd74f052 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.607815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd0f97-c0bc-460d-9153-daa7dd74f052 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.608450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd0f97-c0bc-460d-9153-daa7dd74f052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.610095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd0f97-c0bc-460d-9153-daa7dd74f052 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.621204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1038/2083] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:01:32.622560 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a9f55-a811-445e-963e-f350d50b4a5d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.622834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a9f55-a811-445e-963e-f350d50b4a5d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.623097 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a9f55-a811-445e-963e-f350d50b4a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.644432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-4c5a9f55-a811-445e-963e-f350d50b4a5d None None] MFA Rules not processed for user `ce4f7936bd034eb99d15c1460190ba44`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:32.645952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4c5a9f55-a811-445e-963e-f350d50b4a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:32.654957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1046/2084] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:32 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:32.656058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8626fe-e423-48ac-a733-22d360232a85 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.713627 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1039/2085] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:32.714484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a9f55-a811-445e-963e-f350d50b4a5d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.725957 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a9f55-a811-445e-963e-f350d50b4a5d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.730749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d79db8-48cb-4055-bb05-eeb606137a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.731409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79db8-48cb-4055-bb05-eeb606137a2c admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.731810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79db8-48cb-4055-bb05-eeb606137a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.732133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d79db8-48cb-4055-bb05-eeb606137a2c admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.732846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d79db8-48cb-4055-bb05-eeb606137a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.735120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8626fe-e423-48ac-a733-22d360232a85 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.735244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d79db8-48cb-4055-bb05-eeb606137a2c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.740015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefbc1d-41b7-46f1-9edc-a31bf662de2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.740666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefbc1d-41b7-46f1-9edc-a31bf662de2b admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.740958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefbc1d-41b7-46f1-9edc-a31bf662de2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.741235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefbc1d-41b7-46f1-9edc-a31bf662de2b admin admin] PATH_INFO: `/v3/projects/5332ee2b0a2c4877b06864840747ffc0/users/ce262fe3c3cf48afb01a0932a770179d/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.757194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefbc1d-41b7-46f1-9edc-a31bf662de2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5332ee2b0a2c4877b06864840747ffc0, user_id=ce262fe3c3cf48afb01a0932a770179d, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.759985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefbc1d-41b7-46f1-9edc-a31bf662de2b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.833590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1040/2086] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:32 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:32.835919 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1047/2087] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:32 2022] PUT /identity/v3/projects/5332ee2b0a2c4877b06864840747ffc0/users/ce262fe3c3cf48afb01a0932a770179d/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:32.842871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d79db8-48cb-4055-bb05-eeb606137a2c admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.849602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a6521-3f55-41f0-a013-330c0627b242 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.853499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a6521-3f55-41f0-a013-330c0627b242 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.853499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a6521-3f55-41f0-a013-330c0627b242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.855364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d79db8-48cb-4055-bb05-eeb606137a2c admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.883062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-981a6521-3f55-41f0-a013-330c0627b242 None None] MFA Rules not processed for user `ce262fe3c3cf48afb01a0932a770179d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:32.884282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-981a6521-3f55-41f0-a013-330c0627b242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:32.924635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2b072-b3aa-4f17-bff1-24c061df1cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.925448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2b072-b3aa-4f17-bff1-24c061df1cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.925805 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2b072-b3aa-4f17-bff1-24c061df1cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.926146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2b072-b3aa-4f17-bff1-24c061df1cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.926863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2b072-b3aa-4f17-bff1-24c061df1cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.928585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2b072-b3aa-4f17-bff1-24c061df1cb4 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.942739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1041/2088] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:32.943833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2b072-b3aa-4f17-bff1-24c061df1cb4 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.955616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2b072-b3aa-4f17-bff1-24c061df1cb4 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:32.962992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec0909-3262-45cd-92eb-b95e78ca98f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:32.963612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec0909-3262-45cd-92eb-b95e78ca98f3 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:32.963890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec0909-3262-45cd-92eb-b95e78ca98f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:32.964164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec0909-3262-45cd-92eb-b95e78ca98f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:32.964395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1048/2089] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:32.964808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec0909-3262-45cd-92eb-b95e78ca98f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:32.966491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec0909-3262-45cd-92eb-b95e78ca98f3 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:32.977223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a6521-3f55-41f0-a013-330c0627b242 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.981621 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1042/2090] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:32.981767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-981a6521-3f55-41f0-a013-330c0627b242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:32.984411 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec0909-3262-45cd-92eb-b95e78ca98f3 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:32.995579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec0909-3262-45cd-92eb-b95e78ca98f3 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:33.001189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7678a3-78f2-4447-b865-fe4c438cd8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:33.002067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7678a3-78f2-4447-b865-fe4c438cd8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:33.002349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7678a3-78f2-4447-b865-fe4c438cd8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:33.002620 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7678a3-78f2-4447-b865-fe4c438cd8bd admin admin] PATH_INFO: `/v3/projects/ee064b3ba629450e8ffd83971f70f5cf/users/42856709cc534b0aa0f798e0b68b5f51/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:33.023066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7678a3-78f2-4447-b865-fe4c438cd8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee064b3ba629450e8ffd83971f70f5cf, user_id=42856709cc534b0aa0f798e0b68b5f51, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:33.025770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7678a3-78f2-4447-b865-fe4c438cd8bd admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:33.048639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a6521-3f55-41f0-a013-330c0627b242 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:33.052505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610b545-0e7a-4e74-8bb8-826689222faa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:33.053104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610b545-0e7a-4e74-8bb8-826689222faa service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:33.053413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610b545-0e7a-4e74-8bb8-826689222faa service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:33.053682 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610b545-0e7a-4e74-8bb8-826689222faa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:33.062496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610b545-0e7a-4e74-8bb8-826689222faa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:33.064512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610b545-0e7a-4e74-8bb8-826689222faa service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:33.073335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1049/2091] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:33.100654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610b545-0e7a-4e74-8bb8-826689222faa service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:33.111837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610b545-0e7a-4e74-8bb8-826689222faa service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:33.117239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:33.117923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:33.118227 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:33.118505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] PATH_INFO: `/v3/users/ce262fe3c3cf48afb01a0932a770179d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:33.119661 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce262fe3c3cf48afb01a0932a770179d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:33.121605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:33.146973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1043/2092] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:32 2022] PUT /identity/v3/projects/ee064b3ba629450e8ffd83971f70f5cf/users/42856709cc534b0aa0f798e0b68b5f51/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:33.154479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea515b-86b3-4480-b5e6-328415ef3fb1 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:33.154760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea515b-86b3-4480-b5e6-328415ef3fb1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:33.155027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea515b-86b3-4480-b5e6-328415ef3fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:33.183666 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-fdea515b-86b3-4480-b5e6-328415ef3fb1 None None] MFA Rules not processed for user `42856709cc534b0aa0f798e0b68b5f51`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:33.185036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fdea515b-86b3-4480-b5e6-328415ef3fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:33.254047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:33.256083 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1044/2093] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:33.267504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea515b-86b3-4480-b5e6-328415ef3fb1 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:33.268940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fdea515b-86b3-4480-b5e6-328415ef3fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:33.312704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce262fe3c3cf48afb01a0932a770179d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:33.325393 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce262fe3c3cf48afb01a0932a770179d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:33.326071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce262fe3c3cf48afb01a0932a770179d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:33.326734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce262fe3c3cf48afb01a0932a770179d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:33.331546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea515b-86b3-4480-b5e6-328415ef3fb1 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:33.335842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee831fc-8283-4d5e-aa21-300613f3c0e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:33.336541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee831fc-8283-4d5e-aa21-300613f3c0e3 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:33.336815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee831fc-8283-4d5e-aa21-300613f3c0e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:33.336982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee831fc-8283-4d5e-aa21-300613f3c0e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:33.338871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5ee831fc-8283-4d5e-aa21-300613f3c0e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:33.352550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee831fc-8283-4d5e-aa21-300613f3c0e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:33.353556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee831fc-8283-4d5e-aa21-300613f3c0e3 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:33.366261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1045/2094] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:01:33.396209 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee831fc-8283-4d5e-aa21-300613f3c0e3 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:33.398047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5ee831fc-8283-4d5e-aa21-300613f3c0e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:33.412264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2eaf5f02-9a8c-418e-bd42-978d0cc36d9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce262fe3c3cf48afb01a0932a770179d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:33.444683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1050/2095] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:33 2022] DELETE /identity/v3/users/ce262fe3c3cf48afb01a0932a770179d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:33.447811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936ed4b-9a29-4445-bedb-9af9b95d3d3b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:33.448290 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936ed4b-9a29-4445-bedb-9af9b95d3d3b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:33.448581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936ed4b-9a29-4445-bedb-9af9b95d3d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:33.507841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f936ed4b-9a29-4445-bedb-9af9b95d3d3b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:33.509930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f936ed4b-9a29-4445-bedb-9af9b95d3d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:33.545269 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee831fc-8283-4d5e-aa21-300613f3c0e3 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:33.606453 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1051/2096] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:33.613509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936ed4b-9a29-4445-bedb-9af9b95d3d3b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:33.615889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f936ed4b-9a29-4445-bedb-9af9b95d3d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:33.620147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:33.620775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:33.621051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:33.621355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] PATH_INFO: `/v3/users/42856709cc534b0aa0f798e0b68b5f51` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:33.622504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42856709cc534b0aa0f798e0b68b5f51)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:33.624419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:33.672578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936ed4b-9a29-4445-bedb-9af9b95d3d3b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:33.676251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffec656-0052-4934-bcdc-cdd5ccb4dd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:33.676850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffec656-0052-4934-bcdc-cdd5ccb4dd71 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:33.677122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffec656-0052-4934-bcdc-cdd5ccb4dd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:33.677426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffec656-0052-4934-bcdc-cdd5ccb4dd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:33.687303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffec656-0052-4934-bcdc-cdd5ccb4dd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:33.692205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffec656-0052-4934-bcdc-cdd5ccb4dd71 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:33.698508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1052/2097] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:01:33.841064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42856709cc534b0aa0f798e0b68b5f51'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:33.852515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42856709cc534b0aa0f798e0b68b5f51'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:33.865888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42856709cc534b0aa0f798e0b68b5f51'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:33.867080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42856709cc534b0aa0f798e0b68b5f51'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:33.868296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42856709cc534b0aa0f798e0b68b5f51'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:34.026893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1046/2098] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:33 2022] DELETE /identity/v3/users/42856709cc534b0aa0f798e0b68b5f51 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:34.031393 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb955ed2-34a5-4814-a000-8d47d93629e9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:34.031678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb955ed2-34a5-4814-a000-8d47d93629e9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:34.032472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb955ed2-34a5-4814-a000-8d47d93629e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:34.051927 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cb955ed2-34a5-4814-a000-8d47d93629e9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:34.053206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cb955ed2-34a5-4814-a000-8d47d93629e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:34.109521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1053/2099] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:34.126932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:34.126932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:34.179751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f783ea6-fb46-4230-850c-b6d821122bd0 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:34.183254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e9454-37c8-4a07-8cdf-3b0c3354b0e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:34.183851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9454-37c8-4a07-8cdf-3b0c3354b0e7 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:34.184118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9454-37c8-4a07-8cdf-3b0c3354b0e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:34.184420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9454-37c8-4a07-8cdf-3b0c3354b0e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:34.197154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:34.197339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e9454-37c8-4a07-8cdf-3b0c3354b0e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:34.197339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e9454-37c8-4a07-8cdf-3b0c3354b0e7 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:34.197552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb955ed2-34a5-4814-a000-8d47d93629e9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:34.198691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cb955ed2-34a5-4814-a000-8d47d93629e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:34.209367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1047/2100] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:34.220436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb955ed2-34a5-4814-a000-8d47d93629e9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:34.232380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:34.233070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:34.233374 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:34.233653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] PATH_INFO: `/v3/projects/5332ee2b0a2c4877b06864840747ffc0` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:34.234766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5332ee2b0a2c4877b06864840747ffc0)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:34.236688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:34.293596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:34.344407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5332ee2b0a2c4877b06864840747ffc0', 'request_id': 'req-c297de39-9a3a-4d86-9b55-d5998309f017'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:34.350587 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5332ee2b0a2c4877b06864840747ffc0', 'request_id': 'req-c297de39-9a3a-4d86-9b55-d5998309f017'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:34.435622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5332ee2b0a2c4877b06864840747ffc0', 'request_id': 'req-c297de39-9a3a-4d86-9b55-d5998309f017'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:34.447880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] The token cache is being invalidate because project 5332ee2b0a2c4877b06864840747ffc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:34.448292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:34.449128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c297de39-9a3a-4d86-9b55-d5998309f017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:34.450998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1054/2101] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:34 2022] DELETE /identity/v3/projects/5332ee2b0a2c4877b06864840747ffc0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:34.455727 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75f943-67da-46f2-9522-31be515b8a3d None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:34.456104 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75f943-67da-46f2-9522-31be515b8a3d None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:34.456461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75f943-67da-46f2-9522-31be515b8a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:34.478881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-cf75f943-67da-46f2-9522-31be515b8a3d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:34.480067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-cf75f943-67da-46f2-9522-31be515b8a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:34.554928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1048/2102] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:34.564211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4b67-4d67-4d8c-9838-d744c4f94a6c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:34.565159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4b67-4d67-4d8c-9838-d744c4f94a6c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:34.565879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4b67-4d67-4d8c-9838-d744c4f94a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:34.619701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d47f4b67-4d67-4d8c-9838-d744c4f94a6c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:34.622822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d47f4b67-4d67-4d8c-9838-d744c4f94a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:34.648506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1055/2103] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:34.651389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75f943-67da-46f2-9522-31be515b8a3d None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:34.661625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75f943-67da-46f2-9522-31be515b8a3d None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:34.666724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2a222-d7f9-4120-b91e-8e4368418285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:34.667532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2a222-d7f9-4120-b91e-8e4368418285 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:34.668402 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2a222-d7f9-4120-b91e-8e4368418285 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:34.668972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2a222-d7f9-4120-b91e-8e4368418285 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:34.669955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2a222-d7f9-4120-b91e-8e4368418285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:34.670452 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2a222-d7f9-4120-b91e-8e4368418285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:34.672810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2a222-d7f9-4120-b91e-8e4368418285 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:34.685651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1049/2104] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:34.690583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f4b67-4d67-4d8c-9838-d744c4f94a6c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:34.699980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f4b67-4d67-4d8c-9838-d744c4f94a6c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:34.705454 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57991276-ea69-400b-ab30-6fa5eab4fe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:34.707648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57991276-ea69-400b-ab30-6fa5eab4fe02 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:34.707648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57991276-ea69-400b-ab30-6fa5eab4fe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:34.707648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57991276-ea69-400b-ab30-6fa5eab4fe02 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:34.707648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57991276-ea69-400b-ab30-6fa5eab4fe02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:34.711468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57991276-ea69-400b-ab30-6fa5eab4fe02 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:34.744895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2a222-d7f9-4120-b91e-8e4368418285 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:34.744895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-04b2a222-d7f9-4120-b91e-8e4368418285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:34.759618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2a222-d7f9-4120-b91e-8e4368418285 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:34.764794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:34.775854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:34.775854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:34.775854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] PATH_INFO: `/v3/projects/ee064b3ba629450e8ffd83971f70f5cf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:34.775854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee064b3ba629450e8ffd83971f70f5cf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:34.775854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:34.829711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1056/2105] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:34 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:34.833361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57991276-ea69-400b-ab30-6fa5eab4fe02 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:34.899763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57991276-ea69-400b-ab30-6fa5eab4fe02 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:34.904987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adc48-244d-4273-a261-c915429ada84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:34.905854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adc48-244d-4273-a261-c915429ada84 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:34.906127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adc48-244d-4273-a261-c915429ada84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:34.906461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adc48-244d-4273-a261-c915429ada84 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:34.907658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6adc48-244d-4273-a261-c915429ada84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:34.909738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6adc48-244d-4273-a261-c915429ada84 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:34.921997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee064b3ba629450e8ffd83971f70f5cf', 'request_id': 'req-ccf75582-371d-491c-925c-0d22d3076d11'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:34.929353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee064b3ba629450e8ffd83971f70f5cf', 'request_id': 'req-ccf75582-371d-491c-925c-0d22d3076d11'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:34.985116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1057/2106] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:34 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:34.988723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adc48-244d-4273-a261-c915429ada84 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:34.999151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adc48-244d-4273-a261-c915429ada84 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:35.007506 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee064b3ba629450e8ffd83971f70f5cf', 'request_id': 'req-ccf75582-371d-491c-925c-0d22d3076d11'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:35.020858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] The token cache is being invalidate because project ee064b3ba629450e8ffd83971f70f5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:35.021146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:35.021876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ccf75582-371d-491c-925c-0d22d3076d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:35.028695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1050/2107] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:34 2022] DELETE /identity/v3/projects/ee064b3ba629450e8ffd83971f70f5cf => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:35.032559 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0243a4-75c1-4ce6-8569-7a5c89f61547 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.033814 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0243a4-75c1-4ce6-8569-7a5c89f61547 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.034326 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0243a4-75c1-4ce6-8569-7a5c89f61547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.064941 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:35.081038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-2f0243a4-75c1-4ce6-8569-7a5c89f61547 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:35.082354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2f0243a4-75c1-4ce6-8569-7a5c89f61547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:35.091287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2509a-38e9-4f4f-809d-d8ae1f071845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:35.092509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2509a-38e9-4f4f-809d-d8ae1f071845 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.092783 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2509a-38e9-4f4f-809d-d8ae1f071845 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.093048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2509a-38e9-4f4f-809d-d8ae1f071845 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.093725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2509a-38e9-4f4f-809d-d8ae1f071845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:35.096033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2509a-38e9-4f4f-809d-d8ae1f071845 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:35.100840 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:35.107789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1058/2108] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:35.111327 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2509a-38e9-4f4f-809d-d8ae1f071845 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:35.113635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-58f2509a-38e9-4f4f-809d-d8ae1f071845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:35.129014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2509a-38e9-4f4f-809d-d8ae1f071845 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:35.136352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0350-a75c-45bf-9386-659b8807b55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:35.136352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0350-a75c-45bf-9386-659b8807b55a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.136352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0350-a75c-45bf-9386-659b8807b55a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.137187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0350-a75c-45bf-9386-659b8807b55a admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.137868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d0350-a75c-45bf-9386-659b8807b55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:35.139535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d0350-a75c-45bf-9386-659b8807b55a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:35.152070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1059/2109] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:35.156127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0350-a75c-45bf-9386-659b8807b55a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:35.167961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1051/2110] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:35.171084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0350-a75c-45bf-9386-659b8807b55a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:35.176406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bb081-7b19-46c9-87f8-54050a055173 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.176792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bb081-7b19-46c9-87f8-54050a055173 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.176971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bb081-7b19-46c9-87f8-54050a055173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.179032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894fb39-a1d7-4e2f-9a1f-0ae343c261e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:35.180352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894fb39-a1d7-4e2f-9a1f-0ae343c261e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.180352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894fb39-a1d7-4e2f-9a1f-0ae343c261e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.180536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894fb39-a1d7-4e2f-9a1f-0ae343c261e8 admin admin] PATH_INFO: `/v3/projects/f4cd018872c24aa9a6d4194131cdb6b2/users/ae845a7604b6467c9d93a2d5e91dc6c5/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.199144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-619bb081-7b19-46c9-87f8-54050a055173 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:35.201084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-619bb081-7b19-46c9-87f8-54050a055173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:35.201921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894fb39-a1d7-4e2f-9a1f-0ae343c261e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cd018872c24aa9a6d4194131cdb6b2, user_id=ae845a7604b6467c9d93a2d5e91dc6c5, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:35.205466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894fb39-a1d7-4e2f-9a1f-0ae343c261e8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:35.210041 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1052/2111] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:35.214429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bb081-7b19-46c9-87f8-54050a055173 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:35.226006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bb081-7b19-46c9-87f8-54050a055173 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:35.230759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b0f09-8f90-453e-817a-1aaecbadf1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:35.231367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b0f09-8f90-453e-817a-1aaecbadf1ed admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.231634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b0f09-8f90-453e-817a-1aaecbadf1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.231902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b0f09-8f90-453e-817a-1aaecbadf1ed admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.232572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b0f09-8f90-453e-817a-1aaecbadf1ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:35.232871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b0f09-8f90-453e-817a-1aaecbadf1ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:35.234521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b0f09-8f90-453e-817a-1aaecbadf1ed admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:35.245917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1053/2112] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:01:35.250364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b0f09-8f90-453e-817a-1aaecbadf1ed admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:35.260496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b0f09-8f90-453e-817a-1aaecbadf1ed admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:35.265014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a196e2-dbc6-4ae9-9d19-e6361388fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:35.265621 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a196e2-dbc6-4ae9-9d19-e6361388fa07 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.265891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a196e2-dbc6-4ae9-9d19-e6361388fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.266690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a196e2-dbc6-4ae9-9d19-e6361388fa07 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.267290 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a196e2-dbc6-4ae9-9d19-e6361388fa07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:35.269147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a196e2-dbc6-4ae9-9d19-e6361388fa07 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:35.281102 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1060/2113] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:35 2022] PUT /identity/v3/projects/f4cd018872c24aa9a6d4194131cdb6b2/users/ae845a7604b6467c9d93a2d5e91dc6c5/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:35.287042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7683f-7f74-47d5-98c7-f44ecb4cf6bd None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.287213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7683f-7f74-47d5-98c7-f44ecb4cf6bd None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.287493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7683f-7f74-47d5-98c7-f44ecb4cf6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.306302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-41f7683f-7f74-47d5-98c7-f44ecb4cf6bd None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:35.307485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-41f7683f-7f74-47d5-98c7-f44ecb4cf6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:35.366138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1061/2114] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:35.375832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7683f-7f74-47d5-98c7-f44ecb4cf6bd None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:35.377811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-41f7683f-7f74-47d5-98c7-f44ecb4cf6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:35.386477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1054/2115] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:35 2022] POST /identity/v3/projects => generated 361 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:35.392947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a196e2-dbc6-4ae9-9d19-e6361388fa07 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:35.439701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7683f-7f74-47d5-98c7-f44ecb4cf6bd None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:35.456455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a196e2-dbc6-4ae9-9d19-e6361388fa07 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:35.461701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b71b7b-8575-4520-a10b-10be8d052add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:35.463002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b71b7b-8575-4520-a10b-10be8d052add admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.463288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b71b7b-8575-4520-a10b-10be8d052add admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.463551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b71b7b-8575-4520-a10b-10be8d052add admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.464225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b71b7b-8575-4520-a10b-10be8d052add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:35.466446 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b71b7b-8575-4520-a10b-10be8d052add admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:35.488890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98ab73-9d1b-4aef-bbcb-92b1d7523c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:35.489515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98ab73-9d1b-4aef-bbcb-92b1d7523c55 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.489793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98ab73-9d1b-4aef-bbcb-92b1d7523c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.490092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98ab73-9d1b-4aef-bbcb-92b1d7523c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.498802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98ab73-9d1b-4aef-bbcb-92b1d7523c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:35.500227 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98ab73-9d1b-4aef-bbcb-92b1d7523c55 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:35.509920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1062/2116] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:01:35.573694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1055/2117] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:35 2022] POST /identity/v3/users => generated 281 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:35.577670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98ab73-9d1b-4aef-bbcb-92b1d7523c55 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:35.587716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98ab73-9d1b-4aef-bbcb-92b1d7523c55 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:35.592542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143630-5e87-4e09-b3f6-abde2b59687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:35.593151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143630-5e87-4e09-b3f6-abde2b59687b admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.593460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143630-5e87-4e09-b3f6-abde2b59687b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.593842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99143630-5e87-4e09-b3f6-abde2b59687b admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.594518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99143630-5e87-4e09-b3f6-abde2b59687b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:35.596105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99143630-5e87-4e09-b3f6-abde2b59687b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:35.605640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1063/2118] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:35.609564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b71b7b-8575-4520-a10b-10be8d052add admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:35.620530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b71b7b-8575-4520-a10b-10be8d052add admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:35.625114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a5e1-500a-45a3-b5a5-dad3f82ae69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:35.626242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a5e1-500a-45a3-b5a5-dad3f82ae69b admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.626511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a5e1-500a-45a3-b5a5-dad3f82ae69b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.626773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a5e1-500a-45a3-b5a5-dad3f82ae69b admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.627420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a5e1-500a-45a3-b5a5-dad3f82ae69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:35.636111 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a5e1-500a-45a3-b5a5-dad3f82ae69b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:35.650465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1056/2119] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:35.651693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143630-5e87-4e09-b3f6-abde2b59687b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:35.662765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99143630-5e87-4e09-b3f6-abde2b59687b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:35.668212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f6ff1-1ec1-4a33-a8b3-49aa7307eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:35.669086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f6ff1-1ec1-4a33-a8b3-49aa7307eb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.669214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f6ff1-1ec1-4a33-a8b3-49aa7307eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.669535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f6ff1-1ec1-4a33-a8b3-49aa7307eb6a admin admin] PATH_INFO: `/v3/projects/57e2ec9b041245d1b58908a36710b7cd/users/bb51ed6a66ca4327b7dee1f402b7a933/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.690233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f6ff1-1ec1-4a33-a8b3-49aa7307eb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e2ec9b041245d1b58908a36710b7cd, user_id=bb51ed6a66ca4327b7dee1f402b7a933, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:35.693519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f6ff1-1ec1-4a33-a8b3-49aa7307eb6a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:35.791022 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:35.797379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1064/2120] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:35 2022] PUT /identity/v3/projects/57e2ec9b041245d1b58908a36710b7cd/users/bb51ed6a66ca4327b7dee1f402b7a933/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:35.808510 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba42f3-cb03-43bb-a987-6f037abb1c72 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:35.809234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba42f3-cb03-43bb-a987-6f037abb1c72 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:35.809234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba42f3-cb03-43bb-a987-6f037abb1c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:35.839278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-18ba42f3-cb03-43bb-a987-6f037abb1c72 None None] MFA Rules not processed for user `bb51ed6a66ca4327b7dee1f402b7a933`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:35.840651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-18ba42f3-cb03-43bb-a987-6f037abb1c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:35.890272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:35.913233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1057/2121] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:35.950336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f6ff1-1ec1-4a33-a8b3-49aa7307eb6a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:35.952046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-772f6ff1-1ec1-4a33-a8b3-49aa7307eb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:36.016162 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f6ff1-1ec1-4a33-a8b3-49aa7307eb6a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:36.020982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4899-9b2e-45e0-86ae-bf00dd865078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:36.021758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4899-9b2e-45e0-86ae-bf00dd865078 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:36.022338 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4899-9b2e-45e0-86ae-bf00dd865078 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:36.023074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4899-9b2e-45e0-86ae-bf00dd865078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:36.040515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4899-9b2e-45e0-86ae-bf00dd865078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:36.042138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d4899-9b2e-45e0-86ae-bf00dd865078 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:36.053176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1065/2122] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:36.071596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba42f3-cb03-43bb-a987-6f037abb1c72 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:36.178765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba42f3-cb03-43bb-a987-6f037abb1c72 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:36.187622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:36.187622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:36.187622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:36.187622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] PATH_INFO: `/v3/users/bb51ed6a66ca4327b7dee1f402b7a933` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:36.188978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb51ed6a66ca4327b7dee1f402b7a933)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:36.191173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:36.210549 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:36.481572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb51ed6a66ca4327b7dee1f402b7a933'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:36.492932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb51ed6a66ca4327b7dee1f402b7a933'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:36.508795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb51ed6a66ca4327b7dee1f402b7a933'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:36.509641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb51ed6a66ca4327b7dee1f402b7a933'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:36.510302 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb51ed6a66ca4327b7dee1f402b7a933'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:36.592858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1058/2123] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:36 2022] DELETE /identity/v3/users/bb51ed6a66ca4327b7dee1f402b7a933 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:36.597378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d6bdf-46f5-4727-ba85-0993a39bc491 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:36.597767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d6bdf-46f5-4727-ba85-0993a39bc491 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:36.598177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d6bdf-46f5-4727-ba85-0993a39bc491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:36.619450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-547d6bdf-46f5-4727-ba85-0993a39bc491 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:36.620888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-547d6bdf-46f5-4727-ba85-0993a39bc491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:36.689057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1066/2124] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:36.711320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:36.712887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:36.787484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b56647-081c-43fe-8ff3-4c32d000ad3d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:36.791769 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4a200-a5c6-424a-abd2-930933976054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:36.792812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4a200-a5c6-424a-abd2-930933976054 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:36.793082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4a200-a5c6-424a-abd2-930933976054 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:36.793372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4a200-a5c6-424a-abd2-930933976054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:36.795704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:36.804958 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4a200-a5c6-424a-abd2-930933976054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:36.806466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4a200-a5c6-424a-abd2-930933976054 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:36.817745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1059/2125] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:01:36.847336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:37.208098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab89384-1f1d-433d-a3fc-4c5fa94193ae None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:37.208098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab89384-1f1d-433d-a3fc-4c5fa94193ae None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:37.208411 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab89384-1f1d-433d-a3fc-4c5fa94193ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:37.247085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-eab89384-1f1d-433d-a3fc-4c5fa94193ae None None] MFA Rules not processed for user `ae845a7604b6467c9d93a2d5e91dc6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:37.248540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eab89384-1f1d-433d-a3fc-4c5fa94193ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:37.336920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1067/2126] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:37.344836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4a200-a5c6-424a-abd2-930933976054 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:37.346373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-58c4a200-a5c6-424a-abd2-930933976054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:37.413861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4a200-a5c6-424a-abd2-930933976054 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:37.419021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25860c8-6927-402d-9e8e-ab016de596aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:37.419772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25860c8-6927-402d-9e8e-ab016de596aa service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:37.420952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25860c8-6927-402d-9e8e-ab016de596aa service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:37.421458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25860c8-6927-402d-9e8e-ab016de596aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:37.436624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25860c8-6927-402d-9e8e-ab016de596aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:37.443911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25860c8-6927-402d-9e8e-ab016de596aa service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:37.456423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1060/2127] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:37.705042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab89384-1f1d-433d-a3fc-4c5fa94193ae None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:37.706684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eab89384-1f1d-433d-a3fc-4c5fa94193ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:37.725505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab89384-1f1d-433d-a3fc-4c5fa94193ae None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:37.731851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:37.732579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:37.732863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:37.733176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] PATH_INFO: `/v3/projects/57e2ec9b041245d1b58908a36710b7cd` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:37.734352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e2ec9b041245d1b58908a36710b7cd)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:37.736888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:37.883214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e2ec9b041245d1b58908a36710b7cd', 'request_id': 'req-21156674-9650-4bf5-977b-2ab037a45efe'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:37.894209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e2ec9b041245d1b58908a36710b7cd', 'request_id': 'req-21156674-9650-4bf5-977b-2ab037a45efe'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:37.990065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e2ec9b041245d1b58908a36710b7cd', 'request_id': 'req-21156674-9650-4bf5-977b-2ab037a45efe'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:38.006588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] The token cache is being invalidate because project 57e2ec9b041245d1b58908a36710b7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:38.007585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:38.008608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-21156674-9650-4bf5-977b-2ab037a45efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:38.016861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1068/2128] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:37 2022] DELETE /identity/v3/projects/57e2ec9b041245d1b58908a36710b7cd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:38.022793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33897-5262-4562-a630-5c5d92f6919b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:38.023077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33897-5262-4562-a630-5c5d92f6919b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:38.023504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33897-5262-4562-a630-5c5d92f6919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:38.049419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-00a33897-5262-4562-a630-5c5d92f6919b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:38.050522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-00a33897-5262-4562-a630-5c5d92f6919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:38.118685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1061/2129] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:38.127106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ac255-de71-492c-a802-4188b774f5a5 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:38.127479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ac255-de71-492c-a802-4188b774f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:38.127813 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ac255-de71-492c-a802-4188b774f5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:38.148759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c28ac255-de71-492c-a802-4188b774f5a5 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:38.150215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c28ac255-de71-492c-a802-4188b774f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:38.158414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1069/2130] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:38.163040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33897-5262-4562-a630-5c5d92f6919b None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:38.173879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33897-5262-4562-a630-5c5d92f6919b None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:38.178723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856343eb-ded6-4166-8d0d-c8663280675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:38.179341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856343eb-ded6-4166-8d0d-c8663280675c admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:38.179616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856343eb-ded6-4166-8d0d-c8663280675c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:38.179887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856343eb-ded6-4166-8d0d-c8663280675c admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:38.180571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856343eb-ded6-4166-8d0d-c8663280675c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:38.180870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856343eb-ded6-4166-8d0d-c8663280675c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:38.183212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856343eb-ded6-4166-8d0d-c8663280675c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:38.203394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1062/2131] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:38.206743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ac255-de71-492c-a802-4188b774f5a5 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:38.217568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ac255-de71-492c-a802-4188b774f5a5 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:38.224263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8d8fb-779f-49d5-8202-424242a8ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:38.225079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8d8fb-779f-49d5-8202-424242a8ab27 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:38.225320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8d8fb-779f-49d5-8202-424242a8ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:38.225747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8d8fb-779f-49d5-8202-424242a8ab27 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:38.226513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8d8fb-779f-49d5-8202-424242a8ab27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:38.228890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8d8fb-779f-49d5-8202-424242a8ab27 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:38.300147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:38.330229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1070/2132] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:38 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:38.334941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856343eb-ded6-4166-8d0d-c8663280675c admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:38.347387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856343eb-ded6-4166-8d0d-c8663280675c admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:38.398533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:38.431354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918392-8d21-4719-8e07-0aa18037f93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:38.432091 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918392-8d21-4719-8e07-0aa18037f93d admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:38.432575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918392-8d21-4719-8e07-0aa18037f93d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:38.433034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918392-8d21-4719-8e07-0aa18037f93d admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:38.433887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918392-8d21-4719-8e07-0aa18037f93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:38.436101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918392-8d21-4719-8e07-0aa18037f93d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:38.515601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1063/2133] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:38 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:38.519856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8d8fb-779f-49d5-8202-424242a8ab27 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:38.533052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8d8fb-779f-49d5-8202-424242a8ab27 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:38.539283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0943f1-043b-4741-b36a-03abb4ac2f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:38.539283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0943f1-043b-4741-b36a-03abb4ac2f33 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:38.539283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0943f1-043b-4741-b36a-03abb4ac2f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:38.539664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0943f1-043b-4741-b36a-03abb4ac2f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:38.540458 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0943f1-043b-4741-b36a-03abb4ac2f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:38.542221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0943f1-043b-4741-b36a-03abb4ac2f33 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:38.557391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1071/2134] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:38.570711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918392-8d21-4719-8e07-0aa18037f93d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:38.584114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918392-8d21-4719-8e07-0aa18037f93d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:38.593036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd45cc8-796a-4971-8d27-693e010feb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:38.594803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd45cc8-796a-4971-8d27-693e010feb40 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:38.595316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd45cc8-796a-4971-8d27-693e010feb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:38.595691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd45cc8-796a-4971-8d27-693e010feb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:38.596543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd45cc8-796a-4971-8d27-693e010feb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:38.598490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd45cc8-796a-4971-8d27-693e010feb40 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:38.614945 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1064/2135] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:38.620504 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0943f1-043b-4741-b36a-03abb4ac2f33 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:38.635431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0943f1-043b-4741-b36a-03abb4ac2f33 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:38.642926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464a977-b9fd-4c7e-8728-feb11db2f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:38.643715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464a977-b9fd-4c7e-8728-feb11db2f207 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:38.644096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464a977-b9fd-4c7e-8728-feb11db2f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:38.644476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464a977-b9fd-4c7e-8728-feb11db2f207 admin admin] PATH_INFO: `/v3/projects/eeb89428315149f59e6d8141778ac63b/users/8cfec6af36ca4f32bd495750152dcecc/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:38.666432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464a977-b9fd-4c7e-8728-feb11db2f207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb89428315149f59e6d8141778ac63b, user_id=8cfec6af36ca4f32bd495750152dcecc, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:38.669631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464a977-b9fd-4c7e-8728-feb11db2f207 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:38.754557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1072/2136] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:38 2022] PUT /identity/v3/projects/eeb89428315149f59e6d8141778ac63b/users/8cfec6af36ca4f32bd495750152dcecc/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:38.765217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87c998-db0a-4e4a-85ed-c5aea5485a42 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:38.765926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87c998-db0a-4e4a-85ed-c5aea5485a42 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:38.766561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87c998-db0a-4e4a-85ed-c5aea5485a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:38.837568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-6e87c998-db0a-4e4a-85ed-c5aea5485a42 None None] MFA Rules not processed for user `8cfec6af36ca4f32bd495750152dcecc`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:38.842430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6e87c998-db0a-4e4a-85ed-c5aea5485a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:38.991381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1065/2137] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:39.006602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464a977-b9fd-4c7e-8728-feb11db2f207 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:39.161932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464a977-b9fd-4c7e-8728-feb11db2f207 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:39.168288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ef0a0-f2c7-4e8f-9cfd-0c0706b85806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:39.168904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ef0a0-f2c7-4e8f-9cfd-0c0706b85806 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:39.169177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ef0a0-f2c7-4e8f-9cfd-0c0706b85806 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:39.169473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ef0a0-f2c7-4e8f-9cfd-0c0706b85806 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:39.170711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ef0a0-f2c7-4e8f-9cfd-0c0706b85806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:39.172689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ef0a0-f2c7-4e8f-9cfd-0c0706b85806 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:39.269973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1073/2138] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:39 2022] POST /identity/v3/projects => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:39.273678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87c998-db0a-4e4a-85ed-c5aea5485a42 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:39.291534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87c998-db0a-4e4a-85ed-c5aea5485a42 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:39.411792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ecb58-3660-49c7-9333-18b9089d0288 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:39.412099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ecb58-3660-49c7-9333-18b9089d0288 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:39.412341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ecb58-3660-49c7-9333-18b9089d0288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:39.422710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c3281-5440-48b5-ad96-1cc318c2a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:39.427910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3281-5440-48b5-ad96-1cc318c2a033 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:39.427910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3281-5440-48b5-ad96-1cc318c2a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:39.427910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3281-5440-48b5-ad96-1cc318c2a033 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:39.427910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c3281-5440-48b5-ad96-1cc318c2a033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:39.427910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c3281-5440-48b5-ad96-1cc318c2a033 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:39.465526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-517ecb58-3660-49c7-9333-18b9089d0288 None None] MFA Rules not processed for user `ae845a7604b6467c9d93a2d5e91dc6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:39.471884 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-517ecb58-3660-49c7-9333-18b9089d0288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:39.545278 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1066/2139] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:39 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:39.549436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c3281-5440-48b5-ad96-1cc318c2a033 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:39.572605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c3281-5440-48b5-ad96-1cc318c2a033 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:39.579129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce99f1-f490-4406-a6ed-53b3735b14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:39.579801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce99f1-f490-4406-a6ed-53b3735b14a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:39.580155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce99f1-f490-4406-a6ed-53b3735b14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:39.580430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce99f1-f490-4406-a6ed-53b3735b14a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:39.581176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce99f1-f490-4406-a6ed-53b3735b14a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:39.582893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce99f1-f490-4406-a6ed-53b3735b14a1 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:39.590042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1074/2140] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:39.612567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1067/2141] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:39.617962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ecb58-3660-49c7-9333-18b9089d0288 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:39.633355 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ecb58-3660-49c7-9333-18b9089d0288 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:39.640057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42778-66d9-4ce9-ac8e-270f5dad6c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:39.640936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42778-66d9-4ce9-ac8e-270f5dad6c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:39.641340 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42778-66d9-4ce9-ac8e-270f5dad6c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:39.641723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42778-66d9-4ce9-ac8e-270f5dad6c55 admin admin] PATH_INFO: `/v3/projects/3e08cb5b43d74301b10fa7d6ee4bc00d/users/0699aeb40ed341c28e9120153ca9460d/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:39.664443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b42778-66d9-4ce9-ac8e-270f5dad6c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e08cb5b43d74301b10fa7d6ee4bc00d, user_id=0699aeb40ed341c28e9120153ca9460d, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:39.669064 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b42778-66d9-4ce9-ac8e-270f5dad6c55 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:39.761681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1075/2142] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:39 2022] PUT /identity/v3/projects/3e08cb5b43d74301b10fa7d6ee4bc00d/users/0699aeb40ed341c28e9120153ca9460d/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:39.766186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce99f1-f490-4406-a6ed-53b3735b14a1 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:39.777007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce99f1-f490-4406-a6ed-53b3735b14a1 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:39.801861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:39.867372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070d7c7-298e-4a9a-86df-4c7a0ba3319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:39.868360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070d7c7-298e-4a9a-86df-4c7a0ba3319a admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:39.868731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070d7c7-298e-4a9a-86df-4c7a0ba3319a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:39.869079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070d7c7-298e-4a9a-86df-4c7a0ba3319a admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:39.869921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070d7c7-298e-4a9a-86df-4c7a0ba3319a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:39.871654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070d7c7-298e-4a9a-86df-4c7a0ba3319a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:39.887025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1068/2143] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:39.888164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42778-66d9-4ce9-ac8e-270f5dad6c55 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:39.909483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42778-66d9-4ce9-ac8e-270f5dad6c55 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:39.923435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48b511-2096-4878-aaf9-b412c213e443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:39.924182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b511-2096-4878-aaf9-b412c213e443 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:39.924464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b511-2096-4878-aaf9-b412c213e443 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:39.924745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b511-2096-4878-aaf9-b412c213e443 admin admin] PATH_INFO: `/v3/projects/3e08cb5b43d74301b10fa7d6ee4bc00d/users/0699aeb40ed341c28e9120153ca9460d/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:39.927879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48b511-2096-4878-aaf9-b412c213e443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e08cb5b43d74301b10fa7d6ee4bc00d, user_id=0699aeb40ed341c28e9120153ca9460d, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:39.930821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48b511-2096-4878-aaf9-b412c213e443 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:39.946736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1076/2144] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:39 2022] PUT /identity/v3/projects/3e08cb5b43d74301b10fa7d6ee4bc00d/users/0699aeb40ed341c28e9120153ca9460d/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:39.958434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf1e18-1e79-4811-bfed-485cfade0890 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:39.958768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf1e18-1e79-4811-bfed-485cfade0890 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:39.958984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf1e18-1e79-4811-bfed-485cfade0890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:39.995177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-98cf1e18-1e79-4811-bfed-485cfade0890 None None] MFA Rules not processed for user `0699aeb40ed341c28e9120153ca9460d`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:39.996437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-98cf1e18-1e79-4811-bfed-485cfade0890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:40.050225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:40.081418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1069/2145] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:40.093004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48b511-2096-4878-aaf9-b412c213e443 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:40.095320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2d48b511-2096-4878-aaf9-b412c213e443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:40.177580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48b511-2096-4878-aaf9-b412c213e443 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:40.181385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8963d27-c686-4cc0-b525-90fecdee2f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:40.182086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963d27-c686-4cc0-b525-90fecdee2f2c service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:40.182439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963d27-c686-4cc0-b525-90fecdee2f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:40.182867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963d27-c686-4cc0-b525-90fecdee2f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:40.255904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8963d27-c686-4cc0-b525-90fecdee2f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:40.258150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8963d27-c686-4cc0-b525-90fecdee2f2c service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:40.268843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1077/2146] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:40.288135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:41.264046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:41.412408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:41.510243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf1e18-1e79-4811-bfed-485cfade0890 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:41.511753 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-98cf1e18-1e79-4811-bfed-485cfade0890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:41.604464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf1e18-1e79-4811-bfed-485cfade0890 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:41.609029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:41.609756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:41.610032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:41.610299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] PATH_INFO: `/v3/users/a0a225c4d1fa495fabbace43fe951494` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:41.611597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a225c4d1fa495fabbace43fe951494)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:41.613515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:41.803923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a225c4d1fa495fabbace43fe951494'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:41.812009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a225c4d1fa495fabbace43fe951494'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:41.824742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a225c4d1fa495fabbace43fe951494'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:41.825484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a225c4d1fa495fabbace43fe951494'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:41.826192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-beb7865d-8070-4acd-990c-a34b1628b9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a225c4d1fa495fabbace43fe951494'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:41.881485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1070/2147] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:41 2022] DELETE /identity/v3/users/a0a225c4d1fa495fabbace43fe951494 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:01:42.157662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8963d27-c686-4cc0-b525-90fecdee2f2c service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:42.180996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8963d27-c686-4cc0-b525-90fecdee2f2c service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:42.231537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:42.260656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:42.261583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:42.261862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:42.262135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] PATH_INFO: `/v3/projects/dc1c13ea49cc4e1fae44708204286ab9` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:42.263319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1c13ea49cc4e1fae44708204286ab9)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:42.265224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:42.299325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:42.372594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1c13ea49cc4e1fae44708204286ab9', 'request_id': 'req-7ad14ed5-0920-41e0-b030-239fadd80194'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:42.377937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1c13ea49cc4e1fae44708204286ab9', 'request_id': 'req-7ad14ed5-0920-41e0-b030-239fadd80194'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:42.452392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1c13ea49cc4e1fae44708204286ab9', 'request_id': 'req-7ad14ed5-0920-41e0-b030-239fadd80194'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:42.464281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] The token cache is being invalidate because project dc1c13ea49cc4e1fae44708204286ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:42.464544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:42.465158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad14ed5-0920-41e0-b030-239fadd80194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:42.466923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1078/2148] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:42 2022] DELETE /identity/v3/projects/dc1c13ea49cc4e1fae44708204286ab9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:42.472443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b62c9-88ff-4a1e-9d91-9fceb3d3e52f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:42.472883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b62c9-88ff-4a1e-9d91-9fceb3d3e52f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:42.472972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b62c9-88ff-4a1e-9d91-9fceb3d3e52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:42.493584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-be8b62c9-88ff-4a1e-9d91-9fceb3d3e52f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:42.494781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-be8b62c9-88ff-4a1e-9d91-9fceb3d3e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:42.562261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1071/2149] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:42.570114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a781b-5673-4396-8ba2-67d350ea87bc None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:42.570463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a781b-5673-4396-8ba2-67d350ea87bc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:42.570798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a781b-5673-4396-8ba2-67d350ea87bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:42.591948 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4f2a781b-5673-4396-8ba2-67d350ea87bc None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:42.593152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4f2a781b-5673-4396-8ba2-67d350ea87bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:42.602193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1079/2150] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:42.606341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b62c9-88ff-4a1e-9d91-9fceb3d3e52f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:42.612557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:42.618172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b62c9-88ff-4a1e-9d91-9fceb3d3e52f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:42.623197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ce35c-67d7-46d1-b3fa-f5c7f14b8830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:42.623801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ce35c-67d7-46d1-b3fa-f5c7f14b8830 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:42.624070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ce35c-67d7-46d1-b3fa-f5c7f14b8830 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:42.624336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ce35c-67d7-46d1-b3fa-f5c7f14b8830 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:42.625029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ce35c-67d7-46d1-b3fa-f5c7f14b8830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:42.625387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ce35c-67d7-46d1-b3fa-f5c7f14b8830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:42.627092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ce35c-67d7-46d1-b3fa-f5c7f14b8830 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:42.639279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1072/2151] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:42.644349 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a781b-5673-4396-8ba2-67d350ea87bc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:42.656860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a781b-5673-4396-8ba2-67d350ea87bc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:42.659077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffb8ca-d957-4369-b0ef-e49dd9430116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:42.659677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffb8ca-d957-4369-b0ef-e49dd9430116 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:42.659982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffb8ca-d957-4369-b0ef-e49dd9430116 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:42.660254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffb8ca-d957-4369-b0ef-e49dd9430116 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:42.661007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffb8ca-d957-4369-b0ef-e49dd9430116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:42.663030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffb8ca-d957-4369-b0ef-e49dd9430116 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:42.773849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1080/2152] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:42 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:01:42.778239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ce35c-67d7-46d1-b3fa-f5c7f14b8830 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:42.778380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:42.789534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ce35c-67d7-46d1-b3fa-f5c7f14b8830 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:42.850768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb44db-34c7-4bfb-8f14-319645480e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:42.851458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb44db-34c7-4bfb-8f14-319645480e80 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:42.851781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb44db-34c7-4bfb-8f14-319645480e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:42.852152 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb44db-34c7-4bfb-8f14-319645480e80 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:42.852823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb44db-34c7-4bfb-8f14-319645480e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:42.854838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb44db-34c7-4bfb-8f14-319645480e80 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:43.023924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1073/2153] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:42 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:43.027971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffb8ca-d957-4369-b0ef-e49dd9430116 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:43.038658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffb8ca-d957-4369-b0ef-e49dd9430116 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:43.043370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7572b-f965-4bfc-811c-6306f04587f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:43.043977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7572b-f965-4bfc-811c-6306f04587f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:43.044254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7572b-f965-4bfc-811c-6306f04587f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:43.044989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7572b-f965-4bfc-811c-6306f04587f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:43.045146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7572b-f965-4bfc-811c-6306f04587f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:43.046840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7572b-f965-4bfc-811c-6306f04587f7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:43.057214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1081/2154] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:43.061213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb44db-34c7-4bfb-8f14-319645480e80 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:43.071421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb44db-34c7-4bfb-8f14-319645480e80 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:43.076109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734659c2-3e94-4bba-9749-72967a25808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:43.076713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734659c2-3e94-4bba-9749-72967a25808d admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:43.076991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734659c2-3e94-4bba-9749-72967a25808d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:43.077262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734659c2-3e94-4bba-9749-72967a25808d admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:43.078009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734659c2-3e94-4bba-9749-72967a25808d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:43.079619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734659c2-3e94-4bba-9749-72967a25808d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:43.096109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1074/2155] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:43.102393 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7572b-f965-4bfc-811c-6306f04587f7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:43.111689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7572b-f965-4bfc-811c-6306f04587f7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:43.116206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9c2ee-a61a-4851-9f0d-3d59e0d7b40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:43.116854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9c2ee-a61a-4851-9f0d-3d59e0d7b40d admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:43.117150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9c2ee-a61a-4851-9f0d-3d59e0d7b40d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:43.117457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9c2ee-a61a-4851-9f0d-3d59e0d7b40d admin admin] PATH_INFO: `/v3/projects/f08a6e1c369046158507b40700abb048/users/4d58c48313b74f1685c99cb841e2646d/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:43.132554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9c2ee-a61a-4851-9f0d-3d59e0d7b40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08a6e1c369046158507b40700abb048, user_id=4d58c48313b74f1685c99cb841e2646d, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:43.135551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9c2ee-a61a-4851-9f0d-3d59e0d7b40d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:43.169225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:43.298308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1082/2156] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:43 2022] PUT /identity/v3/projects/f08a6e1c369046158507b40700abb048/users/4d58c48313b74f1685c99cb841e2646d/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:43.303764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b42f-7735-408b-bd04-ee536d678167 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:43.304045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b42f-7735-408b-bd04-ee536d678167 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:43.304316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b42f-7735-408b-bd04-ee536d678167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:43.321383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:43.324315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-1ce9b42f-7735-408b-bd04-ee536d678167 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:43.325785 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1ce9b42f-7735-408b-bd04-ee536d678167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:43.397340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1075/2157] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:43.406779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9c2ee-a61a-4851-9f0d-3d59e0d7b40d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:43.408503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-99c9c2ee-a61a-4851-9f0d-3d59e0d7b40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:43.466916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b42f-7735-408b-bd04-ee536d678167 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:43.469455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1ce9b42f-7735-408b-bd04-ee536d678167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:43.497634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b42f-7735-408b-bd04-ee536d678167 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:43.497634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:43.497634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:43.497634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:43.498577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] PATH_INFO: `/v3/users/8cfec6af36ca4f32bd495750152dcecc` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:43.498577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cfec6af36ca4f32bd495750152dcecc)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:43.498577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:43.504706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9c2ee-a61a-4851-9f0d-3d59e0d7b40d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:43.509019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aed617-c085-4bcd-91f9-3007f1dc3dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:43.509958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aed617-c085-4bcd-91f9-3007f1dc3dba service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:43.510337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aed617-c085-4bcd-91f9-3007f1dc3dba service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:43.510707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aed617-c085-4bcd-91f9-3007f1dc3dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:43.512523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:43.521373 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aed617-c085-4bcd-91f9-3007f1dc3dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:43.531871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aed617-c085-4bcd-91f9-3007f1dc3dba service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:43.541370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1083/2158] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:43.748670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfec6af36ca4f32bd495750152dcecc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:43.759987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfec6af36ca4f32bd495750152dcecc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:43.761399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:43.774705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfec6af36ca4f32bd495750152dcecc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:43.775687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfec6af36ca4f32bd495750152dcecc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:43.776552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfec6af36ca4f32bd495750152dcecc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:43.869822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:43.952904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1076/2159] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:43 2022] DELETE /identity/v3/users/8cfec6af36ca4f32bd495750152dcecc => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:43.953574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d7052-4b75-4216-b8ed-d9fdf22f729e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:43.953574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d7052-4b75-4216-b8ed-d9fdf22f729e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:43.953574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d7052-4b75-4216-b8ed-d9fdf22f729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:43.975976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bd9d7052-4b75-4216-b8ed-d9fdf22f729e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:43.978070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bd9d7052-4b75-4216-b8ed-d9fdf22f729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:44.012303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:44.080135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1084/2160] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:44.092441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:44.094613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:44.159569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a159857-19d4-4753-b6c8-c3b7bef92ffd admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:44.163439 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce15e1-8159-4597-9397-2f9ab0f3763b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:44.164047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce15e1-8159-4597-9397-2f9ab0f3763b service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:44.164371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce15e1-8159-4597-9397-2f9ab0f3763b service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:44.164641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce15e1-8159-4597-9397-2f9ab0f3763b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:44.175673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce15e1-8159-4597-9397-2f9ab0f3763b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:44.177221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce15e1-8159-4597-9397-2f9ab0f3763b service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:44.188909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1077/2161] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:44.355704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:44.920108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d7052-4b75-4216-b8ed-d9fdf22f729e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:44.925699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bd9d7052-4b75-4216-b8ed-d9fdf22f729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:44.947897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d7052-4b75-4216-b8ed-d9fdf22f729e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:44.955456 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:44.957562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:44.957562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:44.957562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] PATH_INFO: `/v3/projects/eeb89428315149f59e6d8141778ac63b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:44.962612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb89428315149f59e6d8141778ac63b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:44.965270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:45.134675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb89428315149f59e6d8141778ac63b', 'request_id': 'req-70a76e59-c78a-49b1-882f-a84356374ff2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:45.145689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb89428315149f59e6d8141778ac63b', 'request_id': 'req-70a76e59-c78a-49b1-882f-a84356374ff2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:45.201195 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:45.234813 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb89428315149f59e6d8141778ac63b', 'request_id': 'req-70a76e59-c78a-49b1-882f-a84356374ff2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:45.259479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] The token cache is being invalidate because project eeb89428315149f59e6d8141778ac63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:45.260460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:45.262130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:45.266155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1085/2162] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:44 2022] DELETE /identity/v3/projects/eeb89428315149f59e6d8141778ac63b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:45.270219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce15e1-8159-4597-9397-2f9ab0f3763b service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:45.283268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce15e1-8159-4597-9397-2f9ab0f3763b service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:45.377218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:45.377998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:45.385574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:45.385906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] PATH_INFO: `/v3/users/0699aeb40ed341c28e9120153ca9460d` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:45.387262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0699aeb40ed341c28e9120153ca9460d)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:45.389181 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:45.595231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:45.666025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0699aeb40ed341c28e9120153ca9460d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:45.675216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0699aeb40ed341c28e9120153ca9460d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:45.691361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0699aeb40ed341c28e9120153ca9460d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:45.692166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0699aeb40ed341c28e9120153ca9460d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:45.692773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-2ec14456-d70c-4e80-b1c3-767877cd644b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0699aeb40ed341c28e9120153ca9460d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:45.784971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1078/2163] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:45 2022] DELETE /identity/v3/users/0699aeb40ed341c28e9120153ca9460d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:46.932464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:47.207212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:47.294510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:47.295999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:47.321420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a76e59-c78a-49b1-882f-a84356374ff2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:47.428438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:47.428438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:47.428438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:47.428438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] PATH_INFO: `/v3/projects/3e08cb5b43d74301b10fa7d6ee4bc00d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:47.428938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e08cb5b43d74301b10fa7d6ee4bc00d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:47.438488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:47.571764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e08cb5b43d74301b10fa7d6ee4bc00d', 'request_id': 'req-a63b4303-297c-4c0b-9319-9ee922fe2e1e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:47.581000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e08cb5b43d74301b10fa7d6ee4bc00d', 'request_id': 'req-a63b4303-297c-4c0b-9319-9ee922fe2e1e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:47.666666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e08cb5b43d74301b10fa7d6ee4bc00d', 'request_id': 'req-a63b4303-297c-4c0b-9319-9ee922fe2e1e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:47.685637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] The token cache is being invalidate because project 3e08cb5b43d74301b10fa7d6ee4bc00d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:47.686305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:47.695593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a63b4303-297c-4c0b-9319-9ee922fe2e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:47.697561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b6a37-5b5f-4216-a58f-a639fe209d76 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:47.697850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b6a37-5b5f-4216-a58f-a639fe209d76 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:47.698123 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b6a37-5b5f-4216-a58f-a639fe209d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:47.701655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1086/2164] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:47 2022] DELETE /identity/v3/projects/3e08cb5b43d74301b10fa7d6ee4bc00d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:47.748079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-288b6a37-5b5f-4216-a58f-a639fe209d76 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:47.749709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-288b6a37-5b5f-4216-a58f-a639fe209d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:47.887596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1079/2165] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:47.897027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6bd77-b194-411a-93ab-0b8388b2fc4d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:47.897794 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6bd77-b194-411a-93ab-0b8388b2fc4d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:47.898070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6bd77-b194-411a-93ab-0b8388b2fc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:47.927272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f4d6bd77-b194-411a-93ab-0b8388b2fc4d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:47.928487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f4d6bd77-b194-411a-93ab-0b8388b2fc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:47.938184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1087/2166] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:47.942371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b6a37-5b5f-4216-a58f-a639fe209d76 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:47.953941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b6a37-5b5f-4216-a58f-a639fe209d76 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:47.958909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ecbb5-d7d1-42be-8de9-e6bde4af2ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:47.959520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ecbb5-d7d1-42be-8de9-e6bde4af2ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:47.959844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ecbb5-d7d1-42be-8de9-e6bde4af2ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:47.960166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ecbb5-d7d1-42be-8de9-e6bde4af2ed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:47.960822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ecbb5-d7d1-42be-8de9-e6bde4af2ed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:47.961327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ecbb5-d7d1-42be-8de9-e6bde4af2ed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:47.962853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ecbb5-d7d1-42be-8de9-e6bde4af2ed8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:47.985418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1080/2167] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:01:47.989968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6bd77-b194-411a-93ab-0b8388b2fc4d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:48.000447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6bd77-b194-411a-93ab-0b8388b2fc4d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:48.005966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243629f-97d6-4348-a4bf-85d2d492d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:48.006632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243629f-97d6-4348-a4bf-85d2d492d3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:48.006901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243629f-97d6-4348-a4bf-85d2d492d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:48.007168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243629f-97d6-4348-a4bf-85d2d492d3a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:48.007886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243629f-97d6-4348-a4bf-85d2d492d3a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:48.010729 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243629f-97d6-4348-a4bf-85d2d492d3a5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:48.122422 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1088/2168] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:47 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:48.123623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ecbb5-d7d1-42be-8de9-e6bde4af2ed8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:48.134559 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ecbb5-d7d1-42be-8de9-e6bde4af2ed8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:48.197478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7875d-5fb0-47e8-af0b-4a89868405ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:48.198210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7875d-5fb0-47e8-af0b-4a89868405ee admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:48.198562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7875d-5fb0-47e8-af0b-4a89868405ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:48.198903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7875d-5fb0-47e8-af0b-4a89868405ee admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:48.199601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7875d-5fb0-47e8-af0b-4a89868405ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:48.201881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7875d-5fb0-47e8-af0b-4a89868405ee admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:48.366708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1081/2169] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:48 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:48.370786 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243629f-97d6-4348-a4bf-85d2d492d3a5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:48.381671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243629f-97d6-4348-a4bf-85d2d492d3a5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:48.386416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489395a-529f-4920-9f5d-574291b14ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:48.387027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489395a-529f-4920-9f5d-574291b14ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:48.387305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489395a-529f-4920-9f5d-574291b14ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:48.387576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489395a-529f-4920-9f5d-574291b14ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:48.388220 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489395a-529f-4920-9f5d-574291b14ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:48.389912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489395a-529f-4920-9f5d-574291b14ca0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:48.401654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1089/2170] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:48.407698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7875d-5fb0-47e8-af0b-4a89868405ee admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:48.417731 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7875d-5fb0-47e8-af0b-4a89868405ee admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:48.422458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fdfc5-6edd-4f33-a551-247d899aa4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:48.423030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdfc5-6edd-4f33-a551-247d899aa4cc admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:48.423360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdfc5-6edd-4f33-a551-247d899aa4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:48.423655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdfc5-6edd-4f33-a551-247d899aa4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:48.424301 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fdfc5-6edd-4f33-a551-247d899aa4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:48.425959 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fdfc5-6edd-4f33-a551-247d899aa4cc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:48.445426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1082/2171] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:48.447552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489395a-529f-4920-9f5d-574291b14ca0 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:48.456824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:48.460657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489395a-529f-4920-9f5d-574291b14ca0 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:48.465442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e74037-dab5-49f8-9764-69a599bd21b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:48.466949 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e74037-dab5-49f8-9764-69a599bd21b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:48.467318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e74037-dab5-49f8-9764-69a599bd21b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:48.467576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e74037-dab5-49f8-9764-69a599bd21b8 admin admin] PATH_INFO: `/v3/projects/ae9705d82bfe44d48173dc37cf490c5f/users/43a89ac505a1486e967746f62485eed7/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:48.484110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e74037-dab5-49f8-9764-69a599bd21b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9705d82bfe44d48173dc37cf490c5f, user_id=43a89ac505a1486e967746f62485eed7, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:48.486973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e74037-dab5-49f8-9764-69a599bd21b8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:48.596113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1090/2172] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:48 2022] PUT /identity/v3/projects/ae9705d82bfe44d48173dc37cf490c5f/users/43a89ac505a1486e967746f62485eed7/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:48.607235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bacb1-9084-4c18-933b-6e57e90a4ea0 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:48.607541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bacb1-9084-4c18-933b-6e57e90a4ea0 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:48.607795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bacb1-9084-4c18-933b-6e57e90a4ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:48.650353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-557bacb1-9084-4c18-933b-6e57e90a4ea0 None None] MFA Rules not processed for user `43a89ac505a1486e967746f62485eed7`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:48.652372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-557bacb1-9084-4c18-933b-6e57e90a4ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:48.749354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:48.794428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1083/2173] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:48.811483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e74037-dab5-49f8-9764-69a599bd21b8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:48.813878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-67e74037-dab5-49f8-9764-69a599bd21b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:48.896397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e74037-dab5-49f8-9764-69a599bd21b8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:48.900916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef3c7-61d6-45fc-bd7b-da051c444e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:48.903950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef3c7-61d6-45fc-bd7b-da051c444e71 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:48.904407 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef3c7-61d6-45fc-bd7b-da051c444e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:48.904962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aef3c7-61d6-45fc-bd7b-da051c444e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:48.915358 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aef3c7-61d6-45fc-bd7b-da051c444e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:48.917027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aef3c7-61d6-45fc-bd7b-da051c444e71 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:48.927574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1091/2174] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:49.493478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:50.795749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:51.119326 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c06d33-93b8-41ff-9a31-cb55a627b197 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:51.119608 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c06d33-93b8-41ff-9a31-cb55a627b197 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:51.120139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c06d33-93b8-41ff-9a31-cb55a627b197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:51.157794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b6c06d33-93b8-41ff-9a31-cb55a627b197 None None] MFA Rules not processed for user `4d58c48313b74f1685c99cb841e2646d`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:51.159103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b6c06d33-93b8-41ff-9a31-cb55a627b197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:51.260709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1084/2175] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:51.283092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef3c7-61d6-45fc-bd7b-da051c444e71 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:51.285800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-29aef3c7-61d6-45fc-bd7b-da051c444e71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:51.376302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aef3c7-61d6-45fc-bd7b-da051c444e71 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:51.383170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84bd3b-6090-48ad-a418-b7963f6b61c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:51.383959 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84bd3b-6090-48ad-a418-b7963f6b61c2 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:51.384421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84bd3b-6090-48ad-a418-b7963f6b61c2 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:51.384692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84bd3b-6090-48ad-a418-b7963f6b61c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:51.394467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84bd3b-6090-48ad-a418-b7963f6b61c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:51.396176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84bd3b-6090-48ad-a418-b7963f6b61c2 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:51.407320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1092/2176] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:51.652770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:52.167231 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:52.807472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:53.446372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c06d33-93b8-41ff-9a31-cb55a627b197 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:53.523698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c06d33-93b8-41ff-9a31-cb55a627b197 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:53.530086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:53.541316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:53.542231 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:53.554053 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] PATH_INFO: `/v3/users/43a89ac505a1486e967746f62485eed7` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:53.556236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a89ac505a1486e967746f62485eed7)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:53.558364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:53.577479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:53.745893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a89ac505a1486e967746f62485eed7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:53.753999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a89ac505a1486e967746f62485eed7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:53.769876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a89ac505a1486e967746f62485eed7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:53.771264 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a89ac505a1486e967746f62485eed7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:53.771873 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a89ac505a1486e967746f62485eed7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:53.881400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1085/2177] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:01:53 2022] DELETE /identity/v3/users/43a89ac505a1486e967746f62485eed7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:53.881581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85064da-0416-4d42-99c1-ac6de0e0575c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:53.881581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85064da-0416-4d42-99c1-ac6de0e0575c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:53.881581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85064da-0416-4d42-99c1-ac6de0e0575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:53.904331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a85064da-0416-4d42-99c1-ac6de0e0575c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:53.906314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a85064da-0416-4d42-99c1-ac6de0e0575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:53.980951 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1093/2178] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:53.990805 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:53.994303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:54.065104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4eb6-dfd1-4f95-9288-924749c35f54 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:54.065646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4eb6-dfd1-4f95-9288-924749c35f54 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:54.066095 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4eb6-dfd1-4f95-9288-924749c35f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:54.100553 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61202a91-ce01-425b-b175-501998f6f06b admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:54.106192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4307d3e-670a-4f6d-8a7e-5eca0a59049b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:54.106398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-75bd4eb6-dfd1-4f95-9288-924749c35f54 None None] MFA Rules not processed for user `4d58c48313b74f1685c99cb841e2646d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:54.106945 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4307d3e-670a-4f6d-8a7e-5eca0a59049b service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:54.107234 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4307d3e-670a-4f6d-8a7e-5eca0a59049b service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:54.107659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4307d3e-670a-4f6d-8a7e-5eca0a59049b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:54.108266 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-75bd4eb6-dfd1-4f95-9288-924749c35f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:54.119849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4307d3e-670a-4f6d-8a7e-5eca0a59049b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:54.121367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4307d3e-670a-4f6d-8a7e-5eca0a59049b service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:54.133193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1086/2179] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:54.180694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1094/2180] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:54.223279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:54.823244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:54.912373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4307d3e-670a-4f6d-8a7e-5eca0a59049b service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:54.913845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b4307d3e-670a-4f6d-8a7e-5eca0a59049b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:54.939916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4307d3e-670a-4f6d-8a7e-5eca0a59049b service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:54.941974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:54.942995 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:54.943283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:54.943550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] PATH_INFO: `/v3/projects/ae9705d82bfe44d48173dc37cf490c5f` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:54.944755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9705d82bfe44d48173dc37cf490c5f)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:54.946747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:55.148293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9705d82bfe44d48173dc37cf490c5f', 'request_id': 'req-e1b570de-14af-4380-b0da-2ec6c56e61d0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:55.157075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9705d82bfe44d48173dc37cf490c5f', 'request_id': 'req-e1b570de-14af-4380-b0da-2ec6c56e61d0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:55.228651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9705d82bfe44d48173dc37cf490c5f', 'request_id': 'req-e1b570de-14af-4380-b0da-2ec6c56e61d0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:55.240752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] The token cache is being invalidate because project ae9705d82bfe44d48173dc37cf490c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:01:55.241231 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:55.242051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e1b570de-14af-4380-b0da-2ec6c56e61d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:01:55.244004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1087/2181] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:54 2022] DELETE /identity/v3/projects/ae9705d82bfe44d48173dc37cf490c5f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:55.248697 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29a1ea-631e-45d7-bd30-d8d9670c7450 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:55.251462 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29a1ea-631e-45d7-bd30-d8d9670c7450 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:55.251462 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29a1ea-631e-45d7-bd30-d8d9670c7450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:55.268258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ff29a1ea-631e-45d7-bd30-d8d9670c7450 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:55.269470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ff29a1ea-631e-45d7-bd30-d8d9670c7450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:55.312907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:55.333427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1095/2182] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:01:55.343725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c97c6-c1c5-43a8-a5fc-e93a683018f1 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:55.344130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c97c6-c1c5-43a8-a5fc-e93a683018f1 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:55.344461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c97c6-c1c5-43a8-a5fc-e93a683018f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:55.378640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-560c97c6-c1c5-43a8-a5fc-e93a683018f1 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:55.380094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-560c97c6-c1c5-43a8-a5fc-e93a683018f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:55.395985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29a1ea-631e-45d7-bd30-d8d9670c7450 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:55.396470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1088/2183] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:55.408456 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29a1ea-631e-45d7-bd30-d8d9670c7450 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:55.413627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e906e-acc8-4c55-9023-7783cd1cacb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:55.414467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e906e-acc8-4c55-9023-7783cd1cacb1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:55.414916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e906e-acc8-4c55-9023-7783cd1cacb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:55.415182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e906e-acc8-4c55-9023-7783cd1cacb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:55.415978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e906e-acc8-4c55-9023-7783cd1cacb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:01:55.416429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e906e-acc8-4c55-9023-7783cd1cacb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:55.418201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e906e-acc8-4c55-9023-7783cd1cacb1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:55.433860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1096/2184] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:01:55.438568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c97c6-c1c5-43a8-a5fc-e93a683018f1 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:55.448524 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c97c6-c1c5-43a8-a5fc-e93a683018f1 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:55.455562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c6fd-f6d8-4cae-81ef-f1e84bc6af19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:55.456458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c6fd-f6d8-4cae-81ef-f1e84bc6af19 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:55.456992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c6fd-f6d8-4cae-81ef-f1e84bc6af19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:55.458126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1c6fd-f6d8-4cae-81ef-f1e84bc6af19 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:55.458924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c6fd-f6d8-4cae-81ef-f1e84bc6af19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:55.461850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1c6fd-f6d8-4cae-81ef-f1e84bc6af19 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:55.585861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1089/2185] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:01:55 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:55.590046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e906e-acc8-4c55-9023-7783cd1cacb1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:55.601961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e906e-acc8-4c55-9023-7783cd1cacb1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:55.660747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:55.682288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88e77f-37bc-4dd0-9b30-ea02c6b55eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:55.683605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88e77f-37bc-4dd0-9b30-ea02c6b55eff admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:55.684571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88e77f-37bc-4dd0-9b30-ea02c6b55eff admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:55.685602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88e77f-37bc-4dd0-9b30-ea02c6b55eff admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:55.687062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88e77f-37bc-4dd0-9b30-ea02c6b55eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:55.689253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88e77f-37bc-4dd0-9b30-ea02c6b55eff admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:55.772503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1097/2186] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:01:55 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:01:55.776654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c6fd-f6d8-4cae-81ef-f1e84bc6af19 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:55.787639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1c6fd-f6d8-4cae-81ef-f1e84bc6af19 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:55.792424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf5ed-1e59-4ef3-b41e-93ed75dfa12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:55.793128 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf5ed-1e59-4ef3-b41e-93ed75dfa12c admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:55.793494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf5ed-1e59-4ef3-b41e-93ed75dfa12c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:55.793835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf5ed-1e59-4ef3-b41e-93ed75dfa12c admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:55.794548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccf5ed-1e59-4ef3-b41e-93ed75dfa12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:55.796245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccf5ed-1e59-4ef3-b41e-93ed75dfa12c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:55.810284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1090/2187] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:55.818114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88e77f-37bc-4dd0-9b30-ea02c6b55eff admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:55.829901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88e77f-37bc-4dd0-9b30-ea02c6b55eff admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:55.835983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d5b44-5452-4642-89d4-d40a54e9a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:55.836592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5b44-5452-4642-89d4-d40a54e9a78a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:55.837078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5b44-5452-4642-89d4-d40a54e9a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:55.837528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5b44-5452-4642-89d4-d40a54e9a78a admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:55.838328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d5b44-5452-4642-89d4-d40a54e9a78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:55.840690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d5b44-5452-4642-89d4-d40a54e9a78a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:55.857488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1098/2188] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:01:55.859008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf5ed-1e59-4ef3-b41e-93ed75dfa12c admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:55.871634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf5ed-1e59-4ef3-b41e-93ed75dfa12c admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:55.877253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19433d-0a99-4ba4-b1c0-53d79e6f0dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:55.878215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19433d-0a99-4ba4-b1c0-53d79e6f0dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:55.878556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19433d-0a99-4ba4-b1c0-53d79e6f0dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:55.878884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19433d-0a99-4ba4-b1c0-53d79e6f0dc6 admin admin] PATH_INFO: `/v3/projects/c3e41c5df70544c5a236eea8b4ecad5a/users/f8835bfde9564e1ca36dcd1afd300867/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:55.895890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19433d-0a99-4ba4-b1c0-53d79e6f0dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e41c5df70544c5a236eea8b4ecad5a, user_id=f8835bfde9564e1ca36dcd1afd300867, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:55.898645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19433d-0a99-4ba4-b1c0-53d79e6f0dc6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:55.984188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1091/2189] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:01:55 2022] PUT /identity/v3/projects/c3e41c5df70544c5a236eea8b4ecad5a/users/f8835bfde9564e1ca36dcd1afd300867/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:01:56.001112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f41e-af01-4710-b859-17dfac76cf9f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:56.001849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f41e-af01-4710-b859-17dfac76cf9f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:56.002156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f41e-af01-4710-b859-17dfac76cf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:56.032579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3761f41e-af01-4710-b859-17dfac76cf9f None None] MFA Rules not processed for user `f8835bfde9564e1ca36dcd1afd300867`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:56.033830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3761f41e-af01-4710-b859-17dfac76cf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:56.101871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1099/2190] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:01:56.113233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19433d-0a99-4ba4-b1c0-53d79e6f0dc6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:01:56.114942 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5a19433d-0a99-4ba4-b1c0-53d79e6f0dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:56.181012 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19433d-0a99-4ba4-b1c0-53d79e6f0dc6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:01:56.185103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f4f02-1bfe-4d12-8510-83ed61211e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:01:56.185754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4f02-1bfe-4d12-8510-83ed61211e6f service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:56.186027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4f02-1bfe-4d12-8510-83ed61211e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:56.186294 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4f02-1bfe-4d12-8510-83ed61211e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:56.196268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f4f02-1bfe-4d12-8510-83ed61211e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:01:56.197710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f4f02-1bfe-4d12-8510-83ed61211e6f service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:01:56.210581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1092/2191] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:01:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:01:56.257635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:59.126206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff02b0-ec22-493a-bf7c-7208dcb08398 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:01:59.127005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff02b0-ec22-493a-bf7c-7208dcb08398 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:01:59.127280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff02b0-ec22-493a-bf7c-7208dcb08398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:01:59.147713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f8ff02b0-ec22-493a-bf7c-7208dcb08398 None None] MFA Rules not processed for user `f8835bfde9564e1ca36dcd1afd300867`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:01:59.148907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f8ff02b0-ec22-493a-bf7c-7208dcb08398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:01:59.161494 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1100/2192] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:01:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:00.526246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cd7b1-446f-42cb-9748-24df0e3df7e6 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:00.526799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cd7b1-446f-42cb-9748-24df0e3df7e6 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:00.526799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cd7b1-446f-42cb-9748-24df0e3df7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:00.547348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-632cd7b1-446f-42cb-9748-24df0e3df7e6 None None] MFA Rules not processed for user `ce4f7936bd034eb99d15c1460190ba44`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:00.548576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-632cd7b1-446f-42cb-9748-24df0e3df7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:00.612387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1093/2193] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:09.142040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:10.604498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:21.465668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff02b0-ec22-493a-bf7c-7208dcb08398 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:21.468476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f8ff02b0-ec22-493a-bf7c-7208dcb08398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:21.542125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff02b0-ec22-493a-bf7c-7208dcb08398 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:21.547040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:21.547828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:21.548207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:21.548580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] PATH_INFO: `/v3/users/3b63561933c14c05bfc5689779574777` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:21.549873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b63561933c14c05bfc5689779574777)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:21.552357 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:21.722335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b63561933c14c05bfc5689779574777'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:21.734552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b63561933c14c05bfc5689779574777'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:21.735248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b63561933c14c05bfc5689779574777'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:21.735855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b63561933c14c05bfc5689779574777'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:21.782245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b63561933c14c05bfc5689779574777'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:21.807532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1101/2194] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:02:21 2022] DELETE /identity/v3/users/3b63561933c14c05bfc5689779574777 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:02:21.821714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059328-f16c-44f4-96f5-e6bce4d3d31b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:21.821714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059328-f16c-44f4-96f5-e6bce4d3d31b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:21.821714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059328-f16c-44f4-96f5-e6bce4d3d31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:21.835020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-31059328-f16c-44f4-96f5-e6bce4d3d31b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:21.836166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-31059328-f16c-44f4-96f5-e6bce4d3d31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:21.900608 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1094/2195] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:02:21.910822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:21.912259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:21.972007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5940e7-c8b3-49cc-ac71-bd719ecd12a7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:21.975800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d9524-ea03-4a11-adf0-c5f15df026f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:21.976441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d9524-ea03-4a11-adf0-c5f15df026f3 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:21.976715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d9524-ea03-4a11-adf0-c5f15df026f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:21.976984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d9524-ea03-4a11-adf0-c5f15df026f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:21.986991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d9524-ea03-4a11-adf0-c5f15df026f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:21.988555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d9524-ea03-4a11-adf0-c5f15df026f3 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:21.999692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1102/2196] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:02:22.383206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059328-f16c-44f4-96f5-e6bce4d3d31b None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:22.384610 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-31059328-f16c-44f4-96f5-e6bce4d3d31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:22.396920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059328-f16c-44f4-96f5-e6bce4d3d31b None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:22.402336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:22.402978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:22.403250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:22.403518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] PATH_INFO: `/v3/projects/cee27d39de1a43d09de7d8ce0ce221c4` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:22.404656 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee27d39de1a43d09de7d8ce0ce221c4)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:22.406599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:22.503729 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee27d39de1a43d09de7d8ce0ce221c4', 'request_id': 'req-b3d643f6-4c85-4a4c-b666-4763c483c6fc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:22.512056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee27d39de1a43d09de7d8ce0ce221c4', 'request_id': 'req-b3d643f6-4c85-4a4c-b666-4763c483c6fc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:22.587666 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee27d39de1a43d09de7d8ce0ce221c4', 'request_id': 'req-b3d643f6-4c85-4a4c-b666-4763c483c6fc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:22.602861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] The token cache is being invalidate because project cee27d39de1a43d09de7d8ce0ce221c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:02:22.603430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:22.604480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3d643f6-4c85-4a4c-b666-4763c483c6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:22.606761 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1095/2197] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:02:22 2022] DELETE /identity/v3/projects/cee27d39de1a43d09de7d8ce0ce221c4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:02:22.611659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79572-e0f5-44f2-b38a-d028e53524b2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:22.612546 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79572-e0f5-44f2-b38a-d028e53524b2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:22.612816 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f79572-e0f5-44f2-b38a-d028e53524b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:22.633936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c8f79572-e0f5-44f2-b38a-d028e53524b2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:22.635406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c8f79572-e0f5-44f2-b38a-d028e53524b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:22.659041 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:22.722982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de8e5-3598-4395-a45d-b4ad89f06633 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:22.723262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de8e5-3598-4395-a45d-b4ad89f06633 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:22.723580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de8e5-3598-4395-a45d-b4ad89f06633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:22.726923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1103/2198] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:22.760114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-de4de8e5-3598-4395-a45d-b4ad89f06633 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:22.761323 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-de4de8e5-3598-4395-a45d-b4ad89f06633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:22.770438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1096/2199] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:22.774408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f79572-e0f5-44f2-b38a-d028e53524b2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:22.785021 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f79572-e0f5-44f2-b38a-d028e53524b2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:22.790214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42efcd8-b3b4-474a-b9e3-168b1e3edece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:22.790979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42efcd8-b3b4-474a-b9e3-168b1e3edece admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:22.791320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42efcd8-b3b4-474a-b9e3-168b1e3edece admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:22.791723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42efcd8-b3b4-474a-b9e3-168b1e3edece admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:22.792445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42efcd8-b3b4-474a-b9e3-168b1e3edece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:02:22.792751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42efcd8-b3b4-474a-b9e3-168b1e3edece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:22.794391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42efcd8-b3b4-474a-b9e3-168b1e3edece admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:22.809337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1104/2200] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:02:22.813558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4de8e5-3598-4395-a45d-b4ad89f06633 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:22.823553 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4de8e5-3598-4395-a45d-b4ad89f06633 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:22.830312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ce632-1e9d-4ddd-af2a-f124f7b5679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:22.830452 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ce632-1e9d-4ddd-af2a-f124f7b5679a admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:22.830694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ce632-1e9d-4ddd-af2a-f124f7b5679a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:22.830968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ce632-1e9d-4ddd-af2a-f124f7b5679a admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:22.831633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ce632-1e9d-4ddd-af2a-f124f7b5679a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:22.833641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ce632-1e9d-4ddd-af2a-f124f7b5679a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:22.958855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1097/2201] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:02:22 2022] POST /identity/v3/projects => generated 389 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:02:22.960249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42efcd8-b3b4-474a-b9e3-168b1e3edece admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:22.972207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42efcd8-b3b4-474a-b9e3-168b1e3edece admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:23.028849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552d94b-2965-4f7b-ba81-10379931a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:23.029501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552d94b-2965-4f7b-ba81-10379931a1bb admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:23.029811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552d94b-2965-4f7b-ba81-10379931a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:23.030599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552d94b-2965-4f7b-ba81-10379931a1bb admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:23.031221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552d94b-2965-4f7b-ba81-10379931a1bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:23.033189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552d94b-2965-4f7b-ba81-10379931a1bb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:23.102267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1105/2202] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:02:22 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:02:23.106607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ce632-1e9d-4ddd-af2a-f124f7b5679a admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:23.116832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ce632-1e9d-4ddd-af2a-f124f7b5679a admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:23.121462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a5d4-285c-433f-bea3-3661551fd843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:23.122063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a5d4-285c-433f-bea3-3661551fd843 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:23.122338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a5d4-285c-433f-bea3-3661551fd843 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:23.122606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a5d4-285c-433f-bea3-3661551fd843 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:23.123246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a5d4-285c-433f-bea3-3661551fd843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:23.124853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a5d4-285c-433f-bea3-3661551fd843 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:23.135484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1098/2203] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:02:23.139994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552d94b-2965-4f7b-ba81-10379931a1bb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:23.149988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552d94b-2965-4f7b-ba81-10379931a1bb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:23.154567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e50a6f-7deb-4275-86ab-56329ee2cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:23.155745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e50a6f-7deb-4275-86ab-56329ee2cf42 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:23.156018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e50a6f-7deb-4275-86ab-56329ee2cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:23.156285 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e50a6f-7deb-4275-86ab-56329ee2cf42 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:23.156952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e50a6f-7deb-4275-86ab-56329ee2cf42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:23.158571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e50a6f-7deb-4275-86ab-56329ee2cf42 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:23.169054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1106/2204] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:02:23.173360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a5d4-285c-433f-bea3-3661551fd843 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:23.183423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a5d4-285c-433f-bea3-3661551fd843 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:23.188437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d51c44-93a6-4cfa-bc44-2932fea60462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:23.189115 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d51c44-93a6-4cfa-bc44-2932fea60462 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:23.189430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d51c44-93a6-4cfa-bc44-2932fea60462 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:23.189736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d51c44-93a6-4cfa-bc44-2932fea60462 admin admin] PATH_INFO: `/v3/projects/d0e8230db1da483ea819601fcce4852e/users/eb8bf2eafcd54ada83bde48e1562d567/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:23.205492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d51c44-93a6-4cfa-bc44-2932fea60462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e8230db1da483ea819601fcce4852e, user_id=eb8bf2eafcd54ada83bde48e1562d567, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:23.208124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d51c44-93a6-4cfa-bc44-2932fea60462 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:23.287516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1099/2205] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:02:23 2022] PUT /identity/v3/projects/d0e8230db1da483ea819601fcce4852e/users/eb8bf2eafcd54ada83bde48e1562d567/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:02:23.298738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a5379-f940-4ade-b7dd-1f6411eafddf None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:23.299745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a5379-f940-4ade-b7dd-1f6411eafddf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:23.300435 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a5379-f940-4ade-b7dd-1f6411eafddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:23.336743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-741a5379-f940-4ade-b7dd-1f6411eafddf None None] MFA Rules not processed for user `eb8bf2eafcd54ada83bde48e1562d567`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:23.338070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-741a5379-f940-4ade-b7dd-1f6411eafddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:23.402700 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1107/2206] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:23.414594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d51c44-93a6-4cfa-bc44-2932fea60462 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:23.417866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-92d51c44-93a6-4cfa-bc44-2932fea60462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:23.440999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:23.476700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d51c44-93a6-4cfa-bc44-2932fea60462 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:23.480875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eba5d-5a33-47a6-b8be-44a648b61424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:23.481500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eba5d-5a33-47a6-b8be-44a648b61424 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:23.481772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eba5d-5a33-47a6-b8be-44a648b61424 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:23.482099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eba5d-5a33-47a6-b8be-44a648b61424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:23.490854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eba5d-5a33-47a6-b8be-44a648b61424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:23.492272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eba5d-5a33-47a6-b8be-44a648b61424 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:23.501631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1100/2207] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:02:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:02:33.399270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:33.575930 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=17 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:35.353672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a5379-f940-4ade-b7dd-1f6411eafddf None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:35.427360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a5379-f940-4ade-b7dd-1f6411eafddf None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:35.433728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:35.434384 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:35.434660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:35.434928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] PATH_INFO: `/v3/users/eb8bf2eafcd54ada83bde48e1562d567` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:35.436106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8bf2eafcd54ada83bde48e1562d567)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:35.438074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:35.594892 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8bf2eafcd54ada83bde48e1562d567'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:35.606644 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8bf2eafcd54ada83bde48e1562d567'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:35.607926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8bf2eafcd54ada83bde48e1562d567'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:35.608534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8bf2eafcd54ada83bde48e1562d567'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:35.660481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8bf2eafcd54ada83bde48e1562d567'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:35.673946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1108/2208] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:02:35 2022] DELETE /identity/v3/users/eb8bf2eafcd54ada83bde48e1562d567 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:02:35.678528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9484fb-d553-443c-86c8-99576ccce3e2 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:35.679015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9484fb-d553-443c-86c8-99576ccce3e2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:35.679121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9484fb-d553-443c-86c8-99576ccce3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:35.698179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-8d9484fb-d553-443c-86c8-99576ccce3e2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:35.699362 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8d9484fb-d553-443c-86c8-99576ccce3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:35.756802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1101/2209] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:35.767448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:35.768888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:35.825269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a39110-fe90-4c95-b3ae-ea22a1c1f411 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:35.829137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bd656-2aaf-4cdc-933e-42b6dbdecb56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:35.829762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bd656-2aaf-4cdc-933e-42b6dbdecb56 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:35.830040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bd656-2aaf-4cdc-933e-42b6dbdecb56 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:35.830350 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bd656-2aaf-4cdc-933e-42b6dbdecb56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:35.839199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bd656-2aaf-4cdc-933e-42b6dbdecb56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:35.840863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bd656-2aaf-4cdc-933e-42b6dbdecb56 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:35.850029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1109/2210] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:02:36.256771 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9484fb-d553-443c-86c8-99576ccce3e2 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:36.258218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8d9484fb-d553-443c-86c8-99576ccce3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:36.271086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9484fb-d553-443c-86c8-99576ccce3e2 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:36.276491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:36.277116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:36.277424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:36.282795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] PATH_INFO: `/v3/projects/d0e8230db1da483ea819601fcce4852e` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:36.282795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e8230db1da483ea819601fcce4852e)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:36.282795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:36.412545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e8230db1da483ea819601fcce4852e', 'request_id': 'req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:36.418720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e8230db1da483ea819601fcce4852e', 'request_id': 'req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:36.484129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e8230db1da483ea819601fcce4852e', 'request_id': 'req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:36.495768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] The token cache is being invalidate because project d0e8230db1da483ea819601fcce4852e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:02:36.496088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:36.496786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d0775a33-79b8-4b9e-9c1f-ddc7bf409379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:36.498942 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1102/2211] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:02:36 2022] DELETE /identity/v3/projects/d0e8230db1da483ea819601fcce4852e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:02:36.503990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042215c-9011-41ac-bbaf-a501bcff09e7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:36.504447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042215c-9011-41ac-bbaf-a501bcff09e7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:36.504447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042215c-9011-41ac-bbaf-a501bcff09e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:36.525157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b042215c-9011-41ac-bbaf-a501bcff09e7 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:36.526418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b042215c-9011-41ac-bbaf-a501bcff09e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:36.547886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:36.595758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1110/2212] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:36.603674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abb1b7-be7f-49ec-9360-014bfaf23a44 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:36.603955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abb1b7-be7f-49ec-9360-014bfaf23a44 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:36.604224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abb1b7-be7f-49ec-9360-014bfaf23a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:36.625090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-41abb1b7-be7f-49ec-9360-014bfaf23a44 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:36.626311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-41abb1b7-be7f-49ec-9360-014bfaf23a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:36.634232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1103/2213] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:36.638529 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042215c-9011-41ac-bbaf-a501bcff09e7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:36.648937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042215c-9011-41ac-bbaf-a501bcff09e7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:36.653598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065b659-78a0-4627-b671-bd4872e13d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:36.654212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065b659-78a0-4627-b671-bd4872e13d97 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:36.654491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065b659-78a0-4627-b671-bd4872e13d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:36.654778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065b659-78a0-4627-b671-bd4872e13d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:36.655431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065b659-78a0-4627-b671-bd4872e13d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:02:36.655755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065b659-78a0-4627-b671-bd4872e13d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:36.657383 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065b659-78a0-4627-b671-bd4872e13d97 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:36.668631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1111/2214] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:02:36.673508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abb1b7-be7f-49ec-9360-014bfaf23a44 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:36.684794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abb1b7-be7f-49ec-9360-014bfaf23a44 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:36.691941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48a93-9f2c-4a3c-b4c9-9763ad6f9855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:36.693226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48a93-9f2c-4a3c-b4c9-9763ad6f9855 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:36.693226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48a93-9f2c-4a3c-b4c9-9763ad6f9855 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:36.693226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48a93-9f2c-4a3c-b4c9-9763ad6f9855 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:36.693737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48a93-9f2c-4a3c-b4c9-9763ad6f9855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:36.695603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48a93-9f2c-4a3c-b4c9-9763ad6f9855 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:36.789198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1104/2215] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:02:36 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:02:36.793113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065b659-78a0-4627-b671-bd4872e13d97 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:36.803512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065b659-78a0-4627-b671-bd4872e13d97 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:36.860098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f671d-eed2-4491-8fc5-99140d6ac503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:36.860702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f671d-eed2-4491-8fc5-99140d6ac503 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:36.860979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f671d-eed2-4491-8fc5-99140d6ac503 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:36.861249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f671d-eed2-4491-8fc5-99140d6ac503 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:36.861893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f671d-eed2-4491-8fc5-99140d6ac503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:36.863849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f671d-eed2-4491-8fc5-99140d6ac503 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:36.951897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1112/2216] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:02:36 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:02:36.955994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48a93-9f2c-4a3c-b4c9-9763ad6f9855 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:36.966883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48a93-9f2c-4a3c-b4c9-9763ad6f9855 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:36.971447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249af8a-0b47-40ef-8200-2075cd5e5336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:36.972038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249af8a-0b47-40ef-8200-2075cd5e5336 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:36.972314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249af8a-0b47-40ef-8200-2075cd5e5336 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:36.972582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249af8a-0b47-40ef-8200-2075cd5e5336 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:36.973214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249af8a-0b47-40ef-8200-2075cd5e5336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:36.974818 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249af8a-0b47-40ef-8200-2075cd5e5336 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:36.985340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1105/2217] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:02:36.989114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f671d-eed2-4491-8fc5-99140d6ac503 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:36.999198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f671d-eed2-4491-8fc5-99140d6ac503 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:37.003982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74556dc1-3b30-4b66-84c4-b771dc189142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:37.004571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556dc1-3b30-4b66-84c4-b771dc189142 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:37.004848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556dc1-3b30-4b66-84c4-b771dc189142 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:37.005119 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556dc1-3b30-4b66-84c4-b771dc189142 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:37.005792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74556dc1-3b30-4b66-84c4-b771dc189142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:37.007483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74556dc1-3b30-4b66-84c4-b771dc189142 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:37.017154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1113/2218] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:02:37.021118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249af8a-0b47-40ef-8200-2075cd5e5336 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:37.036225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249af8a-0b47-40ef-8200-2075cd5e5336 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:37.040910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3364c-af6d-4f13-81ee-bfd82327710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:37.041539 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3364c-af6d-4f13-81ee-bfd82327710a admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:37.041818 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3364c-af6d-4f13-81ee-bfd82327710a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:37.042088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3364c-af6d-4f13-81ee-bfd82327710a admin admin] PATH_INFO: `/v3/projects/1f366a209ccf480eaa0ba53e36586fbf/users/899beb2011834ecca7f0a4a40a192950/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:37.050440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cabfb1-3909-4939-aabd-6c58e9153b43 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:37.050835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cabfb1-3909-4939-aabd-6c58e9153b43 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:37.051113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cabfb1-3909-4939-aabd-6c58e9153b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:37.057626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3364c-af6d-4f13-81ee-bfd82327710a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f366a209ccf480eaa0ba53e36586fbf, user_id=899beb2011834ecca7f0a4a40a192950, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:37.060310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3364c-af6d-4f13-81ee-bfd82327710a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:37.070169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f5cabfb1-3909-4939-aabd-6c58e9153b43 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:37.071351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f5cabfb1-3909-4939-aabd-6c58e9153b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:37.079248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1114/2219] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:02:37.102017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cabfb1-3909-4939-aabd-6c58e9153b43 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:37.104788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f5cabfb1-3909-4939-aabd-6c58e9153b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:37.129615 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1106/2220] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:02:37 2022] PUT /identity/v3/projects/1f366a209ccf480eaa0ba53e36586fbf/users/899beb2011834ecca7f0a4a40a192950/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:02:37.144748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ed201-1185-49d5-9289-874b6b903670 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:37.144748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ed201-1185-49d5-9289-874b6b903670 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:37.144748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ed201-1185-49d5-9289-874b6b903670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:37.152716 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ce7ed201-1185-49d5-9289-874b6b903670 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:37.154444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ce7ed201-1185-49d5-9289-874b6b903670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:37.166915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:37.179875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cabfb1-3909-4939-aabd-6c58e9153b43 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:37.200284 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:37.229058 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1107/2221] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:02:37.237481 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ed201-1185-49d5-9289-874b6b903670 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:37.238891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ce7ed201-1185-49d5-9289-874b6b903670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:37.252086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ea292-afa7-4678-a946-af9d6bcdb08d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:37.252699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ea292-afa7-4678-a946-af9d6bcdb08d service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:37.252974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ea292-afa7-4678-a946-af9d6bcdb08d service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:37.253414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ea292-afa7-4678-a946-af9d6bcdb08d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:37.262183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ea292-afa7-4678-a946-af9d6bcdb08d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:37.264139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ea292-afa7-4678-a946-af9d6bcdb08d service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:37.274120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1115/2222] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:02:37.305091 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ed201-1185-49d5-9289-874b6b903670 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:37.308752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce218ba2-c617-4498-bf14-eb8ee1287ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:37.309383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce218ba2-c617-4498-bf14-eb8ee1287ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:37.309655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce218ba2-c617-4498-bf14-eb8ee1287ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:37.309930 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce218ba2-c617-4498-bf14-eb8ee1287ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:37.319205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce218ba2-c617-4498-bf14-eb8ee1287ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:37.320618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce218ba2-c617-4498-bf14-eb8ee1287ee7 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:37.331991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1108/2223] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:02:38.909329 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899de81-664f-4ebe-a8dd-fd78896fd041 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:38.909885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899de81-664f-4ebe-a8dd-fd78896fd041 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:38.909885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899de81-664f-4ebe-a8dd-fd78896fd041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:38.941618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d899de81-664f-4ebe-a8dd-fd78896fd041 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:38.943312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d899de81-664f-4ebe-a8dd-fd78896fd041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:39.011240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1116/2224] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:02:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:39.079011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce218ba2-c617-4498-bf14-eb8ee1287ee7 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:39.080577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ce218ba2-c617-4498-bf14-eb8ee1287ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:39.158245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce218ba2-c617-4498-bf14-eb8ee1287ee7 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:39.164741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e0db4-4100-4e3e-b1c8-8aa970ec0610 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:39.165504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e0db4-4100-4e3e-b1c8-8aa970ec0610 service swift] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:39.165893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e0db4-4100-4e3e-b1c8-8aa970ec0610 service swift] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:39.166653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e0db4-4100-4e3e-b1c8-8aa970ec0610 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:39.175436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e0db4-4100-4e3e-b1c8-8aa970ec0610 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:39.177045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e0db4-4100-4e3e-b1c8-8aa970ec0610 service swift] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:39.188003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1109/2225] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:02:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:40.188585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e371c-566d-4bbb-a5da-b7181783e1e8 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:40.189079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e371c-566d-4bbb-a5da-b7181783e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:40.190665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e371c-566d-4bbb-a5da-b7181783e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:40.210017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-784e371c-566d-4bbb-a5da-b7181783e1e8 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:40.211663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-784e371c-566d-4bbb-a5da-b7181783e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:40.236331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1117/2226] 10.222.0.77 () {58 vars in 967 bytes} [Wed Aug 10 23:02:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:02:40.249833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e0db4-4100-4e3e-b1c8-8aa970ec0610 service swift] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:40.261694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e0db4-4100-4e3e-b1c8-8aa970ec0610 service swift] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:40.268543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267770bb-8c28-4a85-ada9-dfc0857cb248 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:40.269407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267770bb-8c28-4a85-ada9-dfc0857cb248 service swift] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:40.269884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267770bb-8c28-4a85-ada9-dfc0857cb248 service swift] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:40.270339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267770bb-8c28-4a85-ada9-dfc0857cb248 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:40.280222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267770bb-8c28-4a85-ada9-dfc0857cb248 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:40.282367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267770bb-8c28-4a85-ada9-dfc0857cb248 service swift] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:40.298393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1110/2227] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:02:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 23:02:41.099307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ec827-18d2-41ff-b15c-1051e3ff1f9e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:41.100308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ec827-18d2-41ff-b15c-1051e3ff1f9e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:41.100735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ec827-18d2-41ff-b15c-1051e3ff1f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:41.146620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f05ec827-18d2-41ff-b15c-1051e3ff1f9e None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:41.147223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f05ec827-18d2-41ff-b15c-1051e3ff1f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:41.159060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1118/2228] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:02:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:41.174447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267770bb-8c28-4a85-ada9-dfc0857cb248 service swift] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:41.192027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267770bb-8c28-4a85-ada9-dfc0857cb248 service swift] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:41.200140 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01627c-89b4-4b4e-9f40-4f8b581fb465 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:41.201046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01627c-89b4-4b4e-9f40-4f8b581fb465 service swift] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:41.201526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01627c-89b4-4b4e-9f40-4f8b581fb465 service swift] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:41.202144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01627c-89b4-4b4e-9f40-4f8b581fb465 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:41.220171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01627c-89b4-4b4e-9f40-4f8b581fb465 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:41.224168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01627c-89b4-4b4e-9f40-4f8b581fb465 service swift] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:41.232226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1111/2229] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:02:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:41.929192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa44b6-a04d-4bb5-bcde-be6cdd498b03 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:41.929662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa44b6-a04d-4bb5-bcde-be6cdd498b03 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:41.929800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa44b6-a04d-4bb5-bcde-be6cdd498b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:41.992663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8cfa44b6-a04d-4bb5-bcde-be6cdd498b03 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:41.995406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8cfa44b6-a04d-4bb5-bcde-be6cdd498b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:42.023638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1119/2230] 10.222.0.77 () {58 vars in 967 bytes} [Wed Aug 10 23:02:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:42.042814 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01627c-89b4-4b4e-9f40-4f8b581fb465 service swift] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:42.058472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01627c-89b4-4b4e-9f40-4f8b581fb465 service swift] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:42.082532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbfbd5-df2b-4c0f-a59c-f889730f35cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:42.083833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbfbd5-df2b-4c0f-a59c-f889730f35cf service swift] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:42.084340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbfbd5-df2b-4c0f-a59c-f889730f35cf service swift] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:42.084830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbfbd5-df2b-4c0f-a59c-f889730f35cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:42.105653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbfbd5-df2b-4c0f-a59c-f889730f35cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:42.109702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbfbd5-df2b-4c0f-a59c-f889730f35cf service swift] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:42.122674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1112/2231] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:02:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 23:02:43.450780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5c34-a941-48ec-910d-9ccab57b77ff None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:43.451632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5c34-a941-48ec-910d-9ccab57b77ff None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:43.451905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5c34-a941-48ec-910d-9ccab57b77ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:43.479587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6e15-7b2a-493e-b3d0-a32d0906ba00 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:43.480083 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6e15-7b2a-493e-b3d0-a32d0906ba00 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:43.480177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b6e15-7b2a-493e-b3d0-a32d0906ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:43.505696 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b79b5c34-a941-48ec-910d-9ccab57b77ff None None] MFA Rules not processed for user `899beb2011834ecca7f0a4a40a192950`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:43.507062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b79b5c34-a941-48ec-910d-9ccab57b77ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:43.522717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b79b6e15-7b2a-493e-b3d0-a32d0906ba00 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:43.524285 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b79b6e15-7b2a-493e-b3d0-a32d0906ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:43.537983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1113/2232] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:02:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:43.561395 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b6e15-7b2a-493e-b3d0-a32d0906ba00 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:43.576561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b6e15-7b2a-493e-b3d0-a32d0906ba00 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:43.587766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3f776-7753-4855-b04f-650ca4518ce2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:43.590137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3f776-7753-4855-b04f-650ca4518ce2 service swift] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:43.590137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3f776-7753-4855-b04f-650ca4518ce2 service swift] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:43.590137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3f776-7753-4855-b04f-650ca4518ce2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:43.597006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:43.606393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3f776-7753-4855-b04f-650ca4518ce2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:43.608258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3f776-7753-4855-b04f-650ca4518ce2 service swift] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:43.625750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1114/2233] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:02:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 23:02:43.631449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1120/2234] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:43.638773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3f776-7753-4855-b04f-650ca4518ce2 service swift] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:43.650310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3f776-7753-4855-b04f-650ca4518ce2 service swift] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:43.656293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3cca7-6574-4cda-ae59-94f123fb5766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:43.656902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3cca7-6574-4cda-ae59-94f123fb5766 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:43.657185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3cca7-6574-4cda-ae59-94f123fb5766 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:43.657484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3cca7-6574-4cda-ae59-94f123fb5766 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:43.658103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3cca7-6574-4cda-ae59-94f123fb5766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:43.660064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3cca7-6574-4cda-ae59-94f123fb5766 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:43.783110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1115/2235] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:02:43 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:02:43.787425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b5c34-a941-48ec-910d-9ccab57b77ff None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:43.799112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b5c34-a941-48ec-910d-9ccab57b77ff None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:43.825183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:43.834433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7c2b1-d8c7-46a4-8a07-79f15a5f0d3b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:43.834433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7c2b1-d8c7-46a4-8a07-79f15a5f0d3b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:43.834766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7c2b1-d8c7-46a4-8a07-79f15a5f0d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:43.869281 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-24d7c2b1-d8c7-46a4-8a07-79f15a5f0d3b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:43.870803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-24d7c2b1-d8c7-46a4-8a07-79f15a5f0d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:43.950126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc89df-cf7e-444f-a7b2-1ede6d6cfae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:43.951313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc89df-cf7e-444f-a7b2-1ede6d6cfae9 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:43.954529 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc89df-cf7e-444f-a7b2-1ede6d6cfae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:43.955483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc89df-cf7e-444f-a7b2-1ede6d6cfae9 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:43.956310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc89df-cf7e-444f-a7b2-1ede6d6cfae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:43.967591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc89df-cf7e-444f-a7b2-1ede6d6cfae9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:44.021274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1116/2236] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:44.054761 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7c2b1-d8c7-46a4-8a07-79f15a5f0d3b None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:44.155545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1121/2237] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:02:43 2022] POST /identity/v3/users => generated 292 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:02:44.157967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc89df-cf7e-444f-a7b2-1ede6d6cfae9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:44.178013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc89df-cf7e-444f-a7b2-1ede6d6cfae9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:44.194126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72fe2a-8a72-4129-a534-30d085672ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:44.195029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72fe2a-8a72-4129-a534-30d085672ddd admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:44.196773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72fe2a-8a72-4129-a534-30d085672ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:44.197524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72fe2a-8a72-4129-a534-30d085672ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:44.198302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72fe2a-8a72-4129-a534-30d085672ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:44.201817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72fe2a-8a72-4129-a534-30d085672ddd admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:44.245024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7c2b1-d8c7-46a4-8a07-79f15a5f0d3b None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:44.246738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1122/2238] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:02:44.249444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72fe2a-8a72-4129-a534-30d085672ddd admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:44.255308 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3231c3-1775-41c6-8520-5e51fff3a597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:44.256020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3231c3-1775-41c6-8520-5e51fff3a597 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:44.256342 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3231c3-1775-41c6-8520-5e51fff3a597 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:44.256609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3231c3-1775-41c6-8520-5e51fff3a597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:44.269270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3231c3-1775-41c6-8520-5e51fff3a597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:44.269846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72fe2a-8a72-4129-a534-30d085672ddd admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:44.272179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3231c3-1775-41c6-8520-5e51fff3a597 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:44.282570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0298335-2413-4af8-847c-3ee16c496767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:44.283600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0298335-2413-4af8-847c-3ee16c496767 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:44.284023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0298335-2413-4af8-847c-3ee16c496767 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:44.284481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0298335-2413-4af8-847c-3ee16c496767 admin admin] PATH_INFO: `/v3/projects/5b9eac8805104865bf169dfbbababbc4/users/c7caa408d3cf492da529f752237f083a/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:44.296740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1117/2239] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:02:44.321372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0298335-2413-4af8-847c-3ee16c496767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9eac8805104865bf169dfbbababbc4, user_id=c7caa408d3cf492da529f752237f083a, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:44.324264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0298335-2413-4af8-847c-3ee16c496767 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:44.480218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1123/2240] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:02:44 2022] PUT /identity/v3/projects/5b9eac8805104865bf169dfbbababbc4/users/c7caa408d3cf492da529f752237f083a/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:02:44.485196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3231c3-1775-41c6-8520-5e51fff3a597 service nova] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:44.507052 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3231c3-1775-41c6-8520-5e51fff3a597 service nova] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:44.657534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:44.671471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374180d2-be72-430b-a9fe-a2eb30d5939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:44.672255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374180d2-be72-430b-a9fe-a2eb30d5939c admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:44.672531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374180d2-be72-430b-a9fe-a2eb30d5939c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:44.672802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374180d2-be72-430b-a9fe-a2eb30d5939c admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:44.673472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374180d2-be72-430b-a9fe-a2eb30d5939c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:44.675189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374180d2-be72-430b-a9fe-a2eb30d5939c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:44.690393 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1118/2241] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:02:44.695009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0298335-2413-4af8-847c-3ee16c496767 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:44.717118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0298335-2413-4af8-847c-3ee16c496767 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:44.724055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed471f0-d7b8-4cf8-8a2b-fc2d7b36fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:44.725960 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed471f0-d7b8-4cf8-8a2b-fc2d7b36fad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:44.726436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed471f0-d7b8-4cf8-8a2b-fc2d7b36fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:44.749348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed471f0-d7b8-4cf8-8a2b-fc2d7b36fad6 admin admin] PATH_INFO: `/v3/projects/5b9eac8805104865bf169dfbbababbc4/users/c7caa408d3cf492da529f752237f083a/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:44.758987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed471f0-d7b8-4cf8-8a2b-fc2d7b36fad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9eac8805104865bf169dfbbababbc4, user_id=c7caa408d3cf492da529f752237f083a, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:44.767750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed471f0-d7b8-4cf8-8a2b-fc2d7b36fad6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:44.794089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1124/2242] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:02:44 2022] PUT /identity/v3/projects/5b9eac8805104865bf169dfbbababbc4/users/c7caa408d3cf492da529f752237f083a/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:02:45.462207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b338-58bf-4813-809b-2938dfa504c9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:45.462518 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b338-58bf-4813-809b-2938dfa504c9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:45.462791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b338-58bf-4813-809b-2938dfa504c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:45.504164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9795b338-58bf-4813-809b-2938dfa504c9 None None] MFA Rules not processed for user `6cbf62d3f1b44cf582da2659ef133e30`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:45.505574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9795b338-58bf-4813-809b-2938dfa504c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:45.602516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1119/2243] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:45.671323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed471f0-d7b8-4cf8-8a2b-fc2d7b36fad6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:45.676880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5ed471f0-d7b8-4cf8-8a2b-fc2d7b36fad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:45.859427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed471f0-d7b8-4cf8-8a2b-fc2d7b36fad6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:45.874254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:45.874998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:45.875560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:45.876735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] PATH_INFO: `/v3/users/f8835bfde9564e1ca36dcd1afd300867` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:45.879037 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8835bfde9564e1ca36dcd1afd300867)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:45.882524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:46.122258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8835bfde9564e1ca36dcd1afd300867'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:46.143263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:46.145521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8835bfde9564e1ca36dcd1afd300867'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:46.146691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8835bfde9564e1ca36dcd1afd300867'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:46.147900 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8835bfde9564e1ca36dcd1afd300867'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:46.238206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8835bfde9564e1ca36dcd1afd300867'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:46.270151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1125/2244] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:02:45 2022] DELETE /identity/v3/users/f8835bfde9564e1ca36dcd1afd300867 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:02:46.271781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11829ff1-bd9d-4423-a983-6c329874526e None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:46.272071 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11829ff1-bd9d-4423-a983-6c329874526e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:46.272346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11829ff1-bd9d-4423-a983-6c329874526e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:46.320597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-11829ff1-bd9d-4423-a983-6c329874526e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:46.321880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-11829ff1-bd9d-4423-a983-6c329874526e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:46.447310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1120/2245] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:46.462406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:46.463932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:46.611470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b12f72-e233-463e-b026-74c04a18d68b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:46.619104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec5243-9c5b-450b-bb04-4cc327284708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:46.620319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec5243-9c5b-450b-bb04-4cc327284708 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:46.620798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec5243-9c5b-450b-bb04-4cc327284708 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:46.621349 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec5243-9c5b-450b-bb04-4cc327284708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:46.654964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec5243-9c5b-450b-bb04-4cc327284708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:46.660236 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec5243-9c5b-450b-bb04-4cc327284708 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:46.714903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1126/2246] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:02:47.211011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11829ff1-bd9d-4423-a983-6c329874526e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:47.212472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-11829ff1-bd9d-4423-a983-6c329874526e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:47.242368 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11829ff1-bd9d-4423-a983-6c329874526e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:47.257640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:47.258540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:47.259011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:47.259473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] PATH_INFO: `/v3/projects/c3e41c5df70544c5a236eea8b4ecad5a` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:47.262382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e41c5df70544c5a236eea8b4ecad5a)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:47.264578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:47.508070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e41c5df70544c5a236eea8b4ecad5a', 'request_id': 'req-640baf86-fff6-4568-bed4-e6cefedeaab2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:47.516879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e41c5df70544c5a236eea8b4ecad5a', 'request_id': 'req-640baf86-fff6-4568-bed4-e6cefedeaab2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:47.603602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e41c5df70544c5a236eea8b4ecad5a', 'request_id': 'req-640baf86-fff6-4568-bed4-e6cefedeaab2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:47.626550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] The token cache is being invalidate because project c3e41c5df70544c5a236eea8b4ecad5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:02:47.627431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:47.629984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:02:47.633227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1121/2247] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:02:47 2022] DELETE /identity/v3/projects/c3e41c5df70544c5a236eea8b4ecad5a => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:02:49.730180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4268c-f617-46e7-9989-558d8971533c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:49.731245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4268c-f617-46e7-9989-558d8971533c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:49.731680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4268c-f617-46e7-9989-558d8971533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:49.764542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a7f4268c-f617-46e7-9989-558d8971533c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:49.766235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a7f4268c-f617-46e7-9989-558d8971533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:49.846818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1127/2248] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:49.865276 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:49.867286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:49.903053 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:49.982735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640baf86-fff6-4568-bed4-e6cefedeaab2 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:50.000425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72ed88-7592-4852-8876-c16389cbd504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:50.001459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ed88-7592-4852-8876-c16389cbd504 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:50.002008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ed88-7592-4852-8876-c16389cbd504 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:50.002413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72ed88-7592-4852-8876-c16389cbd504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:50.018445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72ed88-7592-4852-8876-c16389cbd504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:50.020312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72ed88-7592-4852-8876-c16389cbd504 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:50.032609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1122/2249] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:02:53.899494 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a0ca-5113-41f7-95bd-b36e6dc9b404 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:53.900106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a0ca-5113-41f7-95bd-b36e6dc9b404 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:53.900106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a0ca-5113-41f7-95bd-b36e6dc9b404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:53.942372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2b52a0ca-5113-41f7-95bd-b36e6dc9b404 None None] MFA Rules not processed for user `c7caa408d3cf492da529f752237f083a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:53.955060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2b52a0ca-5113-41f7-95bd-b36e6dc9b404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:54.111465 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1128/2250] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:54.122240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72ed88-7592-4852-8876-c16389cbd504 service nova] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:54.134390 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72ed88-7592-4852-8876-c16389cbd504 service nova] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:54.140491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb79db-d4a7-468f-866d-fd3be6081b01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:54.141103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb79db-d4a7-468f-866d-fd3be6081b01 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:54.141407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb79db-d4a7-468f-866d-fd3be6081b01 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:54.141671 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb79db-d4a7-468f-866d-fd3be6081b01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:54.143337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-febb79db-d4a7-468f-866d-fd3be6081b01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:54.207883 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb79db-d4a7-468f-866d-fd3be6081b01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:54.209323 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb79db-d4a7-468f-866d-fd3be6081b01 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:54.220341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1123/2251] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:02:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:02:54.962734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1a18-2108-42b7-9e95-5052122e15d7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:54.963311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1a18-2108-42b7-9e95-5052122e15d7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:54.963485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1a18-2108-42b7-9e95-5052122e15d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:55.027599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1bdc1a18-2108-42b7-9e95-5052122e15d7 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:55.029272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1bdc1a18-2108-42b7-9e95-5052122e15d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:55.056233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1129/2252] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:02:55.070251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb79db-d4a7-468f-866d-fd3be6081b01 service nova] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:02:55.083017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb79db-d4a7-468f-866d-fd3be6081b01 service nova] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:02:55.101428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668dc99e-c54d-4946-aedc-848668542638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:02:55.102177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc99e-c54d-4946-aedc-848668542638 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:55.102341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc99e-c54d-4946-aedc-848668542638 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:55.102615 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668dc99e-c54d-4946-aedc-848668542638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:55.134175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dc99e-c54d-4946-aedc-848668542638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:02:55.135737 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668dc99e-c54d-4946-aedc-848668542638 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:02:55.163604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1124/2253] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:02:58.010442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5684-2034-441d-8919-6774e1ff8df4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:02:58.010946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5684-2034-441d-8919-6774e1ff8df4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:02:58.011036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5684-2034-441d-8919-6774e1ff8df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:02:58.019088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:58.034018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-070a5684-2034-441d-8919-6774e1ff8df4 None None] MFA Rules not processed for user `899beb2011834ecca7f0a4a40a192950`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:02:58.038991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-070a5684-2034-441d-8919-6774e1ff8df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:02:58.053732 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1130/2254] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:02:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:03:03.558946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab417e5-3b1b-4560-83b0-6159c9c56edd None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:03.560004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab417e5-3b1b-4560-83b0-6159c9c56edd None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:03.560456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab417e5-3b1b-4560-83b0-6159c9c56edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:03.583643 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7ab417e5-3b1b-4560-83b0-6159c9c56edd None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:03:03.584864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7ab417e5-3b1b-4560-83b0-6159c9c56edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:03.594363 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1125/2255] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:03:03.613737 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5684-2034-441d-8919-6774e1ff8df4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:03.615425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-070a5684-2034-441d-8919-6774e1ff8df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:03.636667 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5684-2034-441d-8919-6774e1ff8df4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:03.642597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eda2b5-6b9c-4c03-adc2-63f598224903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:03.643534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda2b5-6b9c-4c03-adc2-63f598224903 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:03.643955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda2b5-6b9c-4c03-adc2-63f598224903 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:03.644711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda2b5-6b9c-4c03-adc2-63f598224903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:03.654634 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eda2b5-6b9c-4c03-adc2-63f598224903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:03.656680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eda2b5-6b9c-4c03-adc2-63f598224903 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:03.669010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1131/2256] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:03:09.916299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030df26-d0c0-404e-be91-6c8bf82fc209 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:09.916846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030df26-d0c0-404e-be91-6c8bf82fc209 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:09.916846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030df26-d0c0-404e-be91-6c8bf82fc209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:09.919591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65936d-bf46-4cd7-972e-45e6166af5d3 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:09.920026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65936d-bf46-4cd7-972e-45e6166af5d3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:09.920129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65936d-bf46-4cd7-972e-45e6166af5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:09.938168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-8030df26-d0c0-404e-be91-6c8bf82fc209 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:03:09.939418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8030df26-d0c0-404e-be91-6c8bf82fc209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:09.939643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ae65936d-bf46-4cd7-972e-45e6166af5d3 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:03:09.940806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ae65936d-bf46-4cd7-972e-45e6166af5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:09.948873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1132/2257] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:03:09.971013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65936d-bf46-4cd7-972e-45e6166af5d3 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:09.983866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65936d-bf46-4cd7-972e-45e6166af5d3 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:09.989577 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b172e4-1d31-476f-8458-84c1a3406812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:09.990182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b172e4-1d31-476f-8458-84c1a3406812 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:09.990461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b172e4-1d31-476f-8458-84c1a3406812 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:09.990733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b172e4-1d31-476f-8458-84c1a3406812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:09.999893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b172e4-1d31-476f-8458-84c1a3406812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:10.001462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1126/2258] 10.222.0.77 () {58 vars in 967 bytes} [Wed Aug 10 23:03:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:03:10.001658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b172e4-1d31-476f-8458-84c1a3406812 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:10.017360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030df26-d0c0-404e-be91-6c8bf82fc209 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:10.017642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1133/2259] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:03:10.017770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8030df26-d0c0-404e-be91-6c8bf82fc209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:10.052437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:10.087871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030df26-d0c0-404e-be91-6c8bf82fc209 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:10.093830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb6ac4-6ea2-4459-9d62-a95f563b1274 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:10.095407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6ac4-6ea2-4459-9d62-a95f563b1274 service swift] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:10.095407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6ac4-6ea2-4459-9d62-a95f563b1274 service swift] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:10.095407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6ac4-6ea2-4459-9d62-a95f563b1274 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:10.102859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb6ac4-6ea2-4459-9d62-a95f563b1274 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:10.104420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb6ac4-6ea2-4459-9d62-a95f563b1274 service swift] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:10.113396 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1127/2260] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:03:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 23:03:13.095774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b172e4-1d31-476f-8458-84c1a3406812 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:13.098517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b2b172e4-1d31-476f-8458-84c1a3406812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:13.111747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b172e4-1d31-476f-8458-84c1a3406812 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:13.117146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:13.117801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:13.118077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:13.118346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] PATH_INFO: `/v3/users/ce4f7936bd034eb99d15c1460190ba44` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:13.119448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4f7936bd034eb99d15c1460190ba44)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:13.121476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:13.306635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4f7936bd034eb99d15c1460190ba44'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:13.319149 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4f7936bd034eb99d15c1460190ba44'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:13.319810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4f7936bd034eb99d15c1460190ba44'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:13.320406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4f7936bd034eb99d15c1460190ba44'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:13.396409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-af544476-2c46-467d-af52-3b93d2666de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4f7936bd034eb99d15c1460190ba44'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:13.410179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1134/2261] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:03:13 2022] DELETE /identity/v3/users/ce4f7936bd034eb99d15c1460190ba44 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:03:13.662337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb6ac4-6ea2-4459-9d62-a95f563b1274 service swift] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:13.674402 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb6ac4-6ea2-4459-9d62-a95f563b1274 service swift] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:13.740276 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:13.741126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:13.741438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:13.741708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] PATH_INFO: `/v3/projects/5d39b15640bc4194a358c4c54f7f36d7` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:13.742864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d39b15640bc4194a358c4c54f7f36d7)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:13.744826 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:13.849508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d39b15640bc4194a358c4c54f7f36d7', 'request_id': 'req-f6184aab-c4b4-401b-80ff-8e7820e01452'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:13.855932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d39b15640bc4194a358c4c54f7f36d7', 'request_id': 'req-f6184aab-c4b4-401b-80ff-8e7820e01452'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:13.927445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d39b15640bc4194a358c4c54f7f36d7', 'request_id': 'req-f6184aab-c4b4-401b-80ff-8e7820e01452'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:13.938875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] The token cache is being invalidate because project 5d39b15640bc4194a358c4c54f7f36d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:03:13.939185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:13.939851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-f6184aab-c4b4-401b-80ff-8e7820e01452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:13.941711 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1128/2262] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:03:13 2022] DELETE /identity/v3/projects/5d39b15640bc4194a358c4c54f7f36d7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:03:13.946710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb6d06-8c48-41a2-a27c-3f889cd4344d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:13.947089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb6d06-8c48-41a2-a27c-3f889cd4344d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:13.947436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb6d06-8c48-41a2-a27c-3f889cd4344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:13.967256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-abcb6d06-8c48-41a2-a27c-3f889cd4344d None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:03:13.968439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-abcb6d06-8c48-41a2-a27c-3f889cd4344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:14.034198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1135/2263] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:03:14.041767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff051ad-84f2-437e-ac68-9027a1852d82 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:14.042050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff051ad-84f2-437e-ac68-9027a1852d82 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:14.042324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff051ad-84f2-437e-ac68-9027a1852d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:14.062197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-5ff051ad-84f2-437e-ac68-9027a1852d82 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:03:14.063318 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5ff051ad-84f2-437e-ac68-9027a1852d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:14.071439 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1129/2264] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:03:14.075655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb6d06-8c48-41a2-a27c-3f889cd4344d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:14.085096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb6d06-8c48-41a2-a27c-3f889cd4344d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:14.089999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864633e0-f7e5-43ab-97ae-10820a55bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:14.090583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864633e0-f7e5-43ab-97ae-10820a55bbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:14.090861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864633e0-f7e5-43ab-97ae-10820a55bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:14.092046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864633e0-f7e5-43ab-97ae-10820a55bbb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:14.092267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864633e0-f7e5-43ab-97ae-10820a55bbb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:03:14.092570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864633e0-f7e5-43ab-97ae-10820a55bbb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:14.094277 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864633e0-f7e5-43ab-97ae-10820a55bbb9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:14.105382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1136/2265] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:03:14.110413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff051ad-84f2-437e-ac68-9027a1852d82 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:14.119984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff051ad-84f2-437e-ac68-9027a1852d82 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:14.124647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0180c-d508-4362-ab9d-b6d40e6dd8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:14.125247 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0180c-d508-4362-ab9d-b6d40e6dd8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:14.125554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0180c-d508-4362-ab9d-b6d40e6dd8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:14.125823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0180c-d508-4362-ab9d-b6d40e6dd8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:14.126471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0180c-d508-4362-ab9d-b6d40e6dd8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:14.128386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0180c-d508-4362-ab9d-b6d40e6dd8c5 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:14.214973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1130/2266] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:03:14 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:03:14.219559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864633e0-f7e5-43ab-97ae-10820a55bbb9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:14.229501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864633e0-f7e5-43ab-97ae-10820a55bbb9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:14.248810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:14.286426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08aa86-099f-4f6e-bb07-8b5c11c4137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:14.287018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08aa86-099f-4f6e-bb07-8b5c11c4137d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:14.287292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08aa86-099f-4f6e-bb07-8b5c11c4137d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:14.287559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08aa86-099f-4f6e-bb07-8b5c11c4137d admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:14.288175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08aa86-099f-4f6e-bb07-8b5c11c4137d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:14.290101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08aa86-099f-4f6e-bb07-8b5c11c4137d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:14.413659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1137/2267] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:03:14 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:03:14.417833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0180c-d508-4362-ab9d-b6d40e6dd8c5 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:14.428344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0180c-d508-4362-ab9d-b6d40e6dd8c5 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:14.432799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6e2fd-58b2-44f5-ade2-fc43ab00531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:14.433419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6e2fd-58b2-44f5-ade2-fc43ab00531f admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:14.433695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6e2fd-58b2-44f5-ade2-fc43ab00531f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:14.433963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6e2fd-58b2-44f5-ade2-fc43ab00531f admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:14.434592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6e2fd-58b2-44f5-ade2-fc43ab00531f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:14.436203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6e2fd-58b2-44f5-ade2-fc43ab00531f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:14.447274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1131/2268] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:03:14.449860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08aa86-099f-4f6e-bb07-8b5c11c4137d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:14.459963 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08aa86-099f-4f6e-bb07-8b5c11c4137d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:14.464516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85b08-99d6-4373-abd1-f07e8655ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:14.465380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85b08-99d6-4373-abd1-f07e8655ef14 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:14.465652 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85b08-99d6-4373-abd1-f07e8655ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:14.465918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85b08-99d6-4373-abd1-f07e8655ef14 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:14.467161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85b08-99d6-4373-abd1-f07e8655ef14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:14.468727 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85b08-99d6-4373-abd1-f07e8655ef14 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:14.479101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1138/2269] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:03:14.483457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6e2fd-58b2-44f5-ade2-fc43ab00531f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:14.493415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6e2fd-58b2-44f5-ade2-fc43ab00531f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:14.498289 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e159a0-929b-4216-a889-c3f275f52802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:14.498925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e159a0-929b-4216-a889-c3f275f52802 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:14.499341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e159a0-929b-4216-a889-c3f275f52802 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:14.499654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e159a0-929b-4216-a889-c3f275f52802 admin admin] PATH_INFO: `/v3/projects/d0db2650e05e4b369e99f5d2a8177c1a/users/d3c0853cbf714da3a785814d1b05322e/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:14.508249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:14.515253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e159a0-929b-4216-a889-c3f275f52802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0db2650e05e4b369e99f5d2a8177c1a, user_id=d3c0853cbf714da3a785814d1b05322e, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:14.517908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e159a0-929b-4216-a889-c3f275f52802 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:14.619822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1132/2270] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:03:14 2022] PUT /identity/v3/projects/d0db2650e05e4b369e99f5d2a8177c1a/users/d3c0853cbf714da3a785814d1b05322e/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:03:14.631370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d371f9b-be63-409d-bcf5-04d6f9ef9340 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:14.631657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d371f9b-be63-409d-bcf5-04d6f9ef9340 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:14.631934 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d371f9b-be63-409d-bcf5-04d6f9ef9340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:14.664173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9d371f9b-be63-409d-bcf5-04d6f9ef9340 None None] MFA Rules not processed for user `d3c0853cbf714da3a785814d1b05322e`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:03:14.665814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9d371f9b-be63-409d-bcf5-04d6f9ef9340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:14.730013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1139/2271] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:03:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:03:14.741575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e159a0-929b-4216-a889-c3f275f52802 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:14.743387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-27e159a0-929b-4216-a889-c3f275f52802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:14.801009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e159a0-929b-4216-a889-c3f275f52802 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:14.804627 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d63680-2b39-4044-9819-6400955b4129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:14.805221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d63680-2b39-4044-9819-6400955b4129 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:14.805523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d63680-2b39-4044-9819-6400955b4129 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:14.805790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d63680-2b39-4044-9819-6400955b4129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:14.814383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d63680-2b39-4044-9819-6400955b4129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:14.815806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d63680-2b39-4044-9819-6400955b4129 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:14.824398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1133/2272] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:03:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:03:18.873783 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d371f9b-be63-409d-bcf5-04d6f9ef9340 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:18.934989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d371f9b-be63-409d-bcf5-04d6f9ef9340 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:18.939413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:18.940017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:18.940288 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:18.940553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] PATH_INFO: `/v3/users/d3c0853cbf714da3a785814d1b05322e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:18.941663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c0853cbf714da3a785814d1b05322e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:18.943550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:19.100374 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:19.112188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c0853cbf714da3a785814d1b05322e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:19.123734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c0853cbf714da3a785814d1b05322e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:19.124399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c0853cbf714da3a785814d1b05322e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:19.124999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c0853cbf714da3a785814d1b05322e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:19.190121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c0853cbf714da3a785814d1b05322e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:19.203759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1140/2273] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:03:18 2022] DELETE /identity/v3/users/d3c0853cbf714da3a785814d1b05322e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:03:19.208335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622600-7ee0-4c14-883a-95aca17e3d18 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:19.208822 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622600-7ee0-4c14-883a-95aca17e3d18 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:19.208915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622600-7ee0-4c14-883a-95aca17e3d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:19.230637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-39622600-7ee0-4c14-883a-95aca17e3d18 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:03:19.231816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-39622600-7ee0-4c14-883a-95aca17e3d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:19.293040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1134/2274] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:03:19.302737 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:19.309670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:19.368689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfbe36-8c23-4c87-8d41-620699270ca3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:19.372179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e9fb5-751d-4496-af1a-065ba5eeccf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:19.372770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e9fb5-751d-4496-af1a-065ba5eeccf9 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:19.373040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e9fb5-751d-4496-af1a-065ba5eeccf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:19.373324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e9fb5-751d-4496-af1a-065ba5eeccf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:19.382522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e9fb5-751d-4496-af1a-065ba5eeccf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:19.383929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e9fb5-751d-4496-af1a-065ba5eeccf9 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:19.393626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1141/2275] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:03:19.843453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622600-7ee0-4c14-883a-95aca17e3d18 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:19.844856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-39622600-7ee0-4c14-883a-95aca17e3d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:19.859530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622600-7ee0-4c14-883a-95aca17e3d18 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:19.862209 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:19.862839 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:19.863114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:19.863381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] PATH_INFO: `/v3/projects/d0db2650e05e4b369e99f5d2a8177c1a` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:19.864516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0db2650e05e4b369e99f5d2a8177c1a)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:19.867018 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:19.996629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0db2650e05e4b369e99f5d2a8177c1a', 'request_id': 'req-5e0544d7-9061-405e-97de-695470692695'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:20.002857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0db2650e05e4b369e99f5d2a8177c1a', 'request_id': 'req-5e0544d7-9061-405e-97de-695470692695'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:20.070047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0db2650e05e4b369e99f5d2a8177c1a', 'request_id': 'req-5e0544d7-9061-405e-97de-695470692695'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:20.080723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] The token cache is being invalidate because project d0db2650e05e4b369e99f5d2a8177c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:03:20.081008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:20.081682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5e0544d7-9061-405e-97de-695470692695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:03:20.085203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1135/2276] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:03:19 2022] DELETE /identity/v3/projects/d0db2650e05e4b369e99f5d2a8177c1a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:03:25.673281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e9fb5-751d-4496-af1a-065ba5eeccf9 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:25.674850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9e0e9fb5-751d-4496-af1a-065ba5eeccf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:25.746100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e9fb5-751d-4496-af1a-065ba5eeccf9 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:25.796168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:25.806113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fd88e-955d-4256-8c27-6668c44b1ba3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:25.807111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fd88e-955d-4256-8c27-6668c44b1ba3 service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:25.807111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fd88e-955d-4256-8c27-6668c44b1ba3 service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:25.807317 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fd88e-955d-4256-8c27-6668c44b1ba3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:25.809019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f80fd88e-955d-4256-8c27-6668c44b1ba3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:25.819863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fd88e-955d-4256-8c27-6668c44b1ba3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:25.821467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fd88e-955d-4256-8c27-6668c44b1ba3 service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:25.831854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1142/2277] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:03:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:03:30.077832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:30.852722 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45210b84-f576-4b23-86e9-1c1f55dd3f1a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:30.853004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45210b84-f576-4b23-86e9-1c1f55dd3f1a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:30.853274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45210b84-f576-4b23-86e9-1c1f55dd3f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:30.874298 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-45210b84-f576-4b23-86e9-1c1f55dd3f1a None None] MFA Rules not processed for user `ae845a7604b6467c9d93a2d5e91dc6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:03:30.875513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-45210b84-f576-4b23-86e9-1c1f55dd3f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:30.962740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1136/2278] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:03:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:03:36.002003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:40.952046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=25 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:41.434806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fd88e-955d-4256-8c27-6668c44b1ba3 service placement] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:41.436823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f80fd88e-955d-4256-8c27-6668c44b1ba3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:41.495440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fd88e-955d-4256-8c27-6668c44b1ba3 service placement] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:41.499260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31eeaf-8f49-4f72-b0ed-f67725ee17ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:41.499864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31eeaf-8f49-4f72-b0ed-f67725ee17ef service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:41.500138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31eeaf-8f49-4f72-b0ed-f67725ee17ef service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:41.500409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31eeaf-8f49-4f72-b0ed-f67725ee17ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:41.502184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0e31eeaf-8f49-4f72-b0ed-f67725ee17ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:41.564483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31eeaf-8f49-4f72-b0ed-f67725ee17ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:41.565954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31eeaf-8f49-4f72-b0ed-f67725ee17ef service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:41.575283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1143/2279] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:03:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:03:51.571059 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=50 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:54.779541 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d39ab-0270-46ab-82bb-05a8432b7a2c None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:54.779996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d39ab-0270-46ab-82bb-05a8432b7a2c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:54.780280 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d39ab-0270-46ab-82bb-05a8432b7a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:54.800637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-381d39ab-0270-46ab-82bb-05a8432b7a2c None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:03:54.801830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-381d39ab-0270-46ab-82bb-05a8432b7a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:54.861372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1137/2280] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:03:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:03:54.885422 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31eeaf-8f49-4f72-b0ed-f67725ee17ef service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:54.886910 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0e31eeaf-8f49-4f72-b0ed-f67725ee17ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:54.956656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31eeaf-8f49-4f72-b0ed-f67725ee17ef service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:54.961667 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca4c45-d412-4c73-b5d8-275909093607 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:54.962269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4c45-d412-4c73-b5d8-275909093607 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:54.962545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4c45-d412-4c73-b5d8-275909093607 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:54.962817 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4c45-d412-4c73-b5d8-275909093607 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:54.971834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca4c45-d412-4c73-b5d8-275909093607 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:54.973458 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca4c45-d412-4c73-b5d8-275909093607 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:54.981497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1144/2281] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:03:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:55.509825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c946-73a7-45d8-8df6-618e094513a9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:55.509825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c946-73a7-45d8-8df6-618e094513a9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:55.510031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950c946-73a7-45d8-8df6-618e094513a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:55.532005 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-1950c946-73a7-45d8-8df6-618e094513a9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:03:55.533244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1950c946-73a7-45d8-8df6-618e094513a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:55.628353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1138/2282] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:03:55.668552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca4c45-d412-4c73-b5d8-275909093607 service swift] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:03:55.671360 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fcca4c45-d412-4c73-b5d8-275909093607 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:03:55.796391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca4c45-d412-4c73-b5d8-275909093607 service swift] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:03:55.808895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce728d-a8ed-4d28-8f5f-2a282af75b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:03:55.810326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce728d-a8ed-4d28-8f5f-2a282af75b39 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:03:55.810326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce728d-a8ed-4d28-8f5f-2a282af75b39 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:03:55.810326 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce728d-a8ed-4d28-8f5f-2a282af75b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:03:55.824221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce728d-a8ed-4d28-8f5f-2a282af75b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:03:55.831482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce728d-a8ed-4d28-8f5f-2a282af75b39 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:03:55.857560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1145/2283] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:04:01.168184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5964-9116-4d04-8d93-08878198ad42 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:01.168719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5964-9116-4d04-8d93-08878198ad42 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:01.168811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5964-9116-4d04-8d93-08878198ad42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:01.189662 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-dc7d5964-9116-4d04-8d93-08878198ad42 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:04:01.190960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-dc7d5964-9116-4d04-8d93-08878198ad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:01.199197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1139/2284] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:04:01.213426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce728d-a8ed-4d28-8f5f-2a282af75b39 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:04:01.227613 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce728d-a8ed-4d28-8f5f-2a282af75b39 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:04:01.234469 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de3b3b-7769-4059-85a9-903425c1965b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:04:01.235480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de3b3b-7769-4059-85a9-903425c1965b service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:01.236140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de3b3b-7769-4059-85a9-903425c1965b service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:01.236629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de3b3b-7769-4059-85a9-903425c1965b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:01.246424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de3b3b-7769-4059-85a9-903425c1965b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:04:01.248035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de3b3b-7769-4059-85a9-903425c1965b service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:04:01.258540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1146/2285] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:04:05.094117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c473f-b7a2-4f51-b071-65a2d3af9a02 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:05.095240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c473f-b7a2-4f51-b071-65a2d3af9a02 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:05.095403 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c473f-b7a2-4f51-b071-65a2d3af9a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:05.122084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9e9c473f-b7a2-4f51-b071-65a2d3af9a02 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:04:05.123318 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9e9c473f-b7a2-4f51-b071-65a2d3af9a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:05.131755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1140/2286] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:04:05.147182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de3b3b-7769-4059-85a9-903425c1965b service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:04:05.158977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de3b3b-7769-4059-85a9-903425c1965b service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:04:05.164299 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfec50-25d6-43ef-b163-276dec67423e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:04:05.164896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfec50-25d6-43ef-b163-276dec67423e service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:05.165165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfec50-25d6-43ef-b163-276dec67423e service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:05.165464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfec50-25d6-43ef-b163-276dec67423e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:05.174638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfec50-25d6-43ef-b163-276dec67423e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:04:05.176229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfec50-25d6-43ef-b163-276dec67423e service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:04:05.185674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1147/2287] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:04:10.376563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c9c27-dc3c-4bbd-99d1-953d973b2c98 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:10.377067 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c9c27-dc3c-4bbd-99d1-953d973b2c98 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:10.377174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c9c27-dc3c-4bbd-99d1-953d973b2c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:10.398037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-e87c9c27-dc3c-4bbd-99d1-953d973b2c98 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:04:10.399230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e87c9c27-dc3c-4bbd-99d1-953d973b2c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:10.410462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1141/2288] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:04:10.427988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfec50-25d6-43ef-b163-276dec67423e service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:04:10.439539 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfec50-25d6-43ef-b163-276dec67423e service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:04:10.444983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e2170-89c4-4971-b786-ffe36a9c8c18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:04:10.445633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2170-89c4-4971-b786-ffe36a9c8c18 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:10.445910 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2170-89c4-4971-b786-ffe36a9c8c18 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:10.446182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e2170-89c4-4971-b786-ffe36a9c8c18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:10.455094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e2170-89c4-4971-b786-ffe36a9c8c18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:04:10.456685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e2170-89c4-4971-b786-ffe36a9c8c18 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:04:10.466247 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1148/2289] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:04:16.728755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18690bfb-3126-40f2-bb3f-e01ecbda144a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:16.729723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18690bfb-3126-40f2-bb3f-e01ecbda144a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:16.730072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18690bfb-3126-40f2-bb3f-e01ecbda144a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:16.748815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-18690bfb-3126-40f2-bb3f-e01ecbda144a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:04:16.750049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-18690bfb-3126-40f2-bb3f-e01ecbda144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:16.758153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1142/2290] 10.222.0.64 () {58 vars in 1016 bytes} [Wed Aug 10 23:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:04:16.773467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e2170-89c4-4971-b786-ffe36a9c8c18 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:04:16.785732 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e2170-89c4-4971-b786-ffe36a9c8c18 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:04:16.793002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f3378-dbba-4d56-97d1-2cc726c558af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:04:16.793731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f3378-dbba-4d56-97d1-2cc726c558af service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:16.794069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f3378-dbba-4d56-97d1-2cc726c558af service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:16.794339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f3378-dbba-4d56-97d1-2cc726c558af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:16.803048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f3378-dbba-4d56-97d1-2cc726c558af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:04:16.804600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f3378-dbba-4d56-97d1-2cc726c558af service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:04:16.814151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1149/2291] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:04:17.664534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01186c9-2ebb-49f5-86bb-3dfa5b8698da None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:17.664821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01186c9-2ebb-49f5-86bb-3dfa5b8698da None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:17.665156 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01186c9-2ebb-49f5-86bb-3dfa5b8698da None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:17.666476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1143/2292] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:04:17.672184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1c321-9467-4edb-9b2c-a3b2611b4bee None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:17.672657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1c321-9467-4edb-9b2c-a3b2611b4bee None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:17.672998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1c321-9467-4edb-9b2c-a3b2611b4bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:17.693252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a1f1c321-9467-4edb-9b2c-a3b2611b4bee None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:04:17.694536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a1f1c321-9467-4edb-9b2c-a3b2611b4bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:17.706219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1150/2293] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:04:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:04:17.723972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01186c9-2ebb-49f5-86bb-3dfa5b8698da None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:04:17.726285 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c01186c9-2ebb-49f5-86bb-3dfa5b8698da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:17.809350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01186c9-2ebb-49f5-86bb-3dfa5b8698da None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:04:17.812918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef3d2d-22d5-417b-a3c2-120b821e822c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e86be85010d4851a1ce3381832af230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:04:17.813543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef3d2d-22d5-417b-a3c2-120b821e822c service glance] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:17.813815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef3d2d-22d5-417b-a3c2-120b821e822c service glance] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:17.814082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef3d2d-22d5-417b-a3c2-120b821e822c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:17.823992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef3d2d-22d5-417b-a3c2-120b821e822c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:04:17.825448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef3d2d-22d5-417b-a3c2-120b821e822c service glance] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:04:17.836147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1144/2294] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:04:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:04:18.029104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344ace-5ef2-4af0-b02e-772c1e57dc3a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:18.029720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344ace-5ef2-4af0-b02e-772c1e57dc3a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:18.029720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344ace-5ef2-4af0-b02e-772c1e57dc3a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:18.031027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1151/2295] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:04:18.035593 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0aaa2-e3f8-4ad5-be36-00f0f59b0967 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:18.035879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0aaa2-e3f8-4ad5-be36-00f0f59b0967 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:18.036153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0aaa2-e3f8-4ad5-be36-00f0f59b0967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:18.044348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:18.057214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-8aa0aaa2-e3f8-4ad5-be36-00f0f59b0967 None None] MFA Rules not processed for user `ff5c08bfc5e94b65bd4addde267e4598`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:04:18.058435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8aa0aaa2-e3f8-4ad5-be36-00f0f59b0967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:18.064753 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1145/2296] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:04:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:04:18.084106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6344ace-5ef2-4af0-b02e-772c1e57dc3a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:04:18.094976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6344ace-5ef2-4af0-b02e-772c1e57dc3a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:04:18.098669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac52a87-424e-4b2c-a287-b3a766b1167a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:04:18.099287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac52a87-424e-4b2c-a287-b3a766b1167a service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:18.099563 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac52a87-424e-4b2c-a287-b3a766b1167a service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:18.099828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac52a87-424e-4b2c-a287-b3a766b1167a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:18.107639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac52a87-424e-4b2c-a287-b3a766b1167a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:04:18.109065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac52a87-424e-4b2c-a287-b3a766b1167a service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:04:18.116556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1152/2297] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:04:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:04:18.196369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d56ef0-7560-43a2-881a-ab1009386cb0 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:18.196658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d56ef0-7560-43a2-881a-ab1009386cb0 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:18.196933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d56ef0-7560-43a2-881a-ab1009386cb0 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:18.198360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1146/2298] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:04:18.204010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a19c-f35e-4a57-be40-a04aa3d7b9f4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:18.204286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a19c-f35e-4a57-be40-a04aa3d7b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:18.204575 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71a19c-f35e-4a57-be40-a04aa3d7b9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:18.212695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:18.224848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-df71a19c-f35e-4a57-be40-a04aa3d7b9f4 None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:04:18.226075 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-df71a19c-f35e-4a57-be40-a04aa3d7b9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:18.235777 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1153/2299] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:04:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:04:18.246080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d56ef0-7560-43a2-881a-ab1009386cb0 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:04:18.256683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d56ef0-7560-43a2-881a-ab1009386cb0 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:04:18.260415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e14a07-e42c-426b-8429-7c6a13d81b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:04:18.260988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e14a07-e42c-426b-8429-7c6a13d81b86 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:18.261266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e14a07-e42c-426b-8429-7c6a13d81b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:18.261562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e14a07-e42c-426b-8429-7c6a13d81b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:18.271267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e14a07-e42c-426b-8429-7c6a13d81b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:04:18.272660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e14a07-e42c-426b-8429-7c6a13d81b86 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:04:18.283557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1147/2300] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:04:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:04:28.240031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:28.279008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=8 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:28.811992 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f0bf-50f5-4809-9ac0-f6e918958869 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:28.812273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f0bf-50f5-4809-9ac0-f6e918958869 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:28.812541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f0bf-50f5-4809-9ac0-f6e918958869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:28.832531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-aa18f0bf-50f5-4809-9ac0-f6e918958869 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:04:28.833768 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aa18f0bf-50f5-4809-9ac0-f6e918958869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:28.841135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1154/2301] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:04:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:04:28.852985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e14a07-e42c-426b-8429-7c6a13d81b86 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:04:28.864214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e14a07-e42c-426b-8429-7c6a13d81b86 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:04:28.869419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57acf1-ea7b-4b11-b3ee-183c454c8ce3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:04:28.870519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57acf1-ea7b-4b11-b3ee-183c454c8ce3 service swift] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:28.870794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57acf1-ea7b-4b11-b3ee-183c454c8ce3 service swift] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:28.871060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57acf1-ea7b-4b11-b3ee-183c454c8ce3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:28.879153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57acf1-ea7b-4b11-b3ee-183c454c8ce3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:04:28.880797 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57acf1-ea7b-4b11-b3ee-183c454c8ce3 service swift] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:04:28.889356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1148/2302] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:04:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:32.680422 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4427543-788d-4483-90c5-ed07a47b587f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:32.680995 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4427543-788d-4483-90c5-ed07a47b587f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:32.680995 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4427543-788d-4483-90c5-ed07a47b587f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:32.711476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c4427543-788d-4483-90c5-ed07a47b587f None None] MFA Rules not processed for user `4d58c48313b74f1685c99cb841e2646d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:04:32.712695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c4427543-788d-4483-90c5-ed07a47b587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:32.775669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1155/2303] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:04:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:04:38.885620 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=6 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:42.764512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=28 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:52.746228 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e5c21-ca62-4f1a-9398-153f4277d55a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:52.751576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e5c21-ca62-4f1a-9398-153f4277d55a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:52.751576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e5c21-ca62-4f1a-9398-153f4277d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:52.767986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-1f3e5c21-ca62-4f1a-9398-153f4277d55a None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:04:52.769195 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1f3e5c21-ca62-4f1a-9398-153f4277d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:04:52.777487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1149/2304] 10.222.0.77 () {58 vars in 967 bytes} [Wed Aug 10 23:04:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:04:52.790723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4427543-788d-4483-90c5-ed07a47b587f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:04:52.805647 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4427543-788d-4483-90c5-ed07a47b587f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:04:52.811300 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6747f-102b-4229-92fd-a622bffd4c17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:04:52.812123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6747f-102b-4229-92fd-a622bffd4c17 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:04:52.812466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6747f-102b-4229-92fd-a622bffd4c17 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:04:52.812803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6747f-102b-4229-92fd-a622bffd4c17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:04:52.823585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6747f-102b-4229-92fd-a622bffd4c17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:04:52.823585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6747f-102b-4229-92fd-a622bffd4c17 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:04:52.831338 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1156/2305] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:04:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:05:02.763262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:02.828056 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:12.157954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e5c21-ca62-4f1a-9398-153f4277d55a None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:05:12.159528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1f3e5c21-ca62-4f1a-9398-153f4277d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:05:12.176789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e5c21-ca62-4f1a-9398-153f4277d55a None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:05:12.183164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:05:12.183926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:05:12.184199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:05:12.184461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] PATH_INFO: `/v3/users/ae845a7604b6467c9d93a2d5e91dc6c5` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:05:12.185779 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae845a7604b6467c9d93a2d5e91dc6c5)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:05:12.187704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:05:12.379912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae845a7604b6467c9d93a2d5e91dc6c5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:05:12.387307 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae845a7604b6467c9d93a2d5e91dc6c5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:05:12.399611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae845a7604b6467c9d93a2d5e91dc6c5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:05:12.405327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae845a7604b6467c9d93a2d5e91dc6c5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:05:12.405327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae845a7604b6467c9d93a2d5e91dc6c5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:05:12.486423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1150/2306] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:05:12 2022] DELETE /identity/v3/users/ae845a7604b6467c9d93a2d5e91dc6c5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:05:12.720150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6747f-102b-4229-92fd-a622bffd4c17 service swift] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:05:12.733175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6747f-102b-4229-92fd-a622bffd4c17 service swift] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:05:12.793862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:05:12.794537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:05:12.794816 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:05:12.795087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] PATH_INFO: `/v3/projects/f4cd018872c24aa9a6d4194131cdb6b2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:05:12.796264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cd018872c24aa9a6d4194131cdb6b2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:05:12.798194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:05:12.895070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cd018872c24aa9a6d4194131cdb6b2', 'request_id': 'req-03530407-a803-4180-9c43-bdf51aa3ff13'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:05:12.901310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cd018872c24aa9a6d4194131cdb6b2', 'request_id': 'req-03530407-a803-4180-9c43-bdf51aa3ff13'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:05:12.973780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cd018872c24aa9a6d4194131cdb6b2', 'request_id': 'req-03530407-a803-4180-9c43-bdf51aa3ff13'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:05:12.984466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] The token cache is being invalidate because project f4cd018872c24aa9a6d4194131cdb6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:05:12.984753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:05:12.985415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:05:12.986891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1157/2307] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:05:12 2022] DELETE /identity/v3/projects/f4cd018872c24aa9a6d4194131cdb6b2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:05:22.482746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:22.981365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:26.378327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:05:26.379730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:05:26.435594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ecc46-cdc0-4b9e-86ab-3b3f4a89856b admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:05:26.482440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c015-c6e0-4353-bb3d-17c97f84b721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:05:26.483054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c015-c6e0-4353-bb3d-17c97f84b721 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:05:26.483326 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c015-c6e0-4353-bb3d-17c97f84b721 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:05:26.483592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c015-c6e0-4353-bb3d-17c97f84b721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:05:26.485313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c539c015-c6e0-4353-bb3d-17c97f84b721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:05:26.553827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539c015-c6e0-4353-bb3d-17c97f84b721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:05:26.566831 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539c015-c6e0-4353-bb3d-17c97f84b721 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:05:26.567587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1151/2308] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:05:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:05:30.250714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:05:30.252127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:05:30.268880 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530407-a803-4180-9c43-bdf51aa3ff13 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:05:30.274277 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80c000-5506-4bef-a6ba-b9db9bd9c0e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:05:30.274926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80c000-5506-4bef-a6ba-b9db9bd9c0e3 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:05:30.275197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80c000-5506-4bef-a6ba-b9db9bd9c0e3 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:05:30.283402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80c000-5506-4bef-a6ba-b9db9bd9c0e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:05:30.283402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fa80c000-5506-4bef-a6ba-b9db9bd9c0e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:05:30.345637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80c000-5506-4bef-a6ba-b9db9bd9c0e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:05:30.347490 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80c000-5506-4bef-a6ba-b9db9bd9c0e3 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:05:30.356636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1158/2309] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:05:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:05:30.408854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c015-c6e0-4353-bb3d-17c97f84b721 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:05:30.409911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c539c015-c6e0-4353-bb3d-17c97f84b721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:05:30.420519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c015-c6e0-4353-bb3d-17c97f84b721 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:05:30.424096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326da841-8f2f-473b-b887-a974273df8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:05:30.424693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da841-8f2f-473b-b887-a974273df8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:05:30.424970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da841-8f2f-473b-b887-a974273df8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:05:30.425233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da841-8f2f-473b-b887-a974273df8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:05:30.426914 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-326da841-8f2f-473b-b887-a974273df8f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:05:30.443945 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326da841-8f2f-473b-b887-a974273df8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:05:30.443945 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326da841-8f2f-473b-b887-a974273df8f1 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:05:30.453463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1152/2310] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:05:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:05:32.922990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbcf0c-073f-44e1-9144-179a1fb70bb7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:05:32.923536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbcf0c-073f-44e1-9144-179a1fb70bb7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:05:32.923536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbcf0c-073f-44e1-9144-179a1fb70bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:05:32.943621 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7bfbcf0c-073f-44e1-9144-179a1fb70bb7 None None] MFA Rules not processed for user `6cbf62d3f1b44cf582da2659ef133e30`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:05:32.944811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7bfbcf0c-073f-44e1-9144-179a1fb70bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:05:32.952220 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1159/2311] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:05:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:05:40.447961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=80 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:42.937186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=31 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:13.645369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326da841-8f2f-473b-b887-a974273df8f1 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:06:13.646812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-326da841-8f2f-473b-b887-a974273df8f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:13.660173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326da841-8f2f-473b-b887-a974273df8f1 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:06:13.669349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bfba4-7ba9-4627-a677-e29f2f3b3442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:06:13.669349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bfba4-7ba9-4627-a677-e29f2f3b3442 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:06:13.669349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bfba4-7ba9-4627-a677-e29f2f3b3442 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:06:13.669349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bfba4-7ba9-4627-a677-e29f2f3b3442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:06:13.669750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a40bfba4-7ba9-4627-a677-e29f2f3b3442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:13.728646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bfba4-7ba9-4627-a677-e29f2f3b3442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:06:13.730251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bfba4-7ba9-4627-a677-e29f2f3b3442 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:06:13.739941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1153/2312] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:06:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:06:19.640907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbcf0c-073f-44e1-9144-179a1fb70bb7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:06:19.659755 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbcf0c-073f-44e1-9144-179a1fb70bb7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:06:19.665862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffceb7-5e3d-4c6c-b0bc-ffdb1e5e9401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:06:19.666807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffceb7-5e3d-4c6c-b0bc-ffdb1e5e9401 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:06:19.667157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffceb7-5e3d-4c6c-b0bc-ffdb1e5e9401 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:06:19.667637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffceb7-5e3d-4c6c-b0bc-ffdb1e5e9401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:06:19.670157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cfffceb7-5e3d-4c6c-b0bc-ffdb1e5e9401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:19.683149 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffceb7-5e3d-4c6c-b0bc-ffdb1e5e9401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:06:19.685010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffceb7-5e3d-4c6c-b0bc-ffdb1e5e9401 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:06:19.696518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1160/2313] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:06:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:06:23.735697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=28 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:24.441078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16d2d6-4728-4424-a7b8-f03dfcaefc88 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:06:24.441399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16d2d6-4728-4424-a7b8-f03dfcaefc88 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:06:24.441673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16d2d6-4728-4424-a7b8-f03dfcaefc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:06:24.461431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7e16d2d6-4728-4424-a7b8-f03dfcaefc88 None None] MFA Rules not processed for user `5f8353e92dc54d08ae0a82381d6d619d`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:06:24.462650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7e16d2d6-4728-4424-a7b8-f03dfcaefc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:24.470377 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1154/2314] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:06:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:06:24.766980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffceb7-5e3d-4c6c-b0bc-ffdb1e5e9401 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:06:24.768447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cfffceb7-5e3d-4c6c-b0bc-ffdb1e5e9401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:24.779373 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffceb7-5e3d-4c6c-b0bc-ffdb1e5e9401 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:06:24.782913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb4ecb-dba6-4cdc-957d-3b6c779dac1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:06:24.783485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb4ecb-dba6-4cdc-957d-3b6c779dac1b service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:06:24.783752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb4ecb-dba6-4cdc-957d-3b6c779dac1b service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:06:24.784018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb4ecb-dba6-4cdc-957d-3b6c779dac1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:06:24.785625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bcdb4ecb-dba6-4cdc-957d-3b6c779dac1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:24.794399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb4ecb-dba6-4cdc-957d-3b6c779dac1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:06:24.795784 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb4ecb-dba6-4cdc-957d-3b6c779dac1b service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:06:24.803311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1161/2315] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:06:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:06:25.229699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16d2d6-4728-4424-a7b8-f03dfcaefc88 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:06:25.231603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7e16d2d6-4728-4424-a7b8-f03dfcaefc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:25.302492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16d2d6-4728-4424-a7b8-f03dfcaefc88 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:06:25.307412 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9dd67-7927-4d65-96e8-90cb1214f101 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:06:25.308008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9dd67-7927-4d65-96e8-90cb1214f101 service placement] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:06:25.308282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9dd67-7927-4d65-96e8-90cb1214f101 service placement] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:06:25.309204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9dd67-7927-4d65-96e8-90cb1214f101 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:06:25.310925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-afa9dd67-7927-4d65-96e8-90cb1214f101 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:25.321792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9dd67-7927-4d65-96e8-90cb1214f101 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:06:25.323359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9dd67-7927-4d65-96e8-90cb1214f101 service placement] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:06:25.333299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1155/2316] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:06:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:06:27.979940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb4ecb-dba6-4cdc-957d-3b6c779dac1b service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:06:27.989315 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb4ecb-dba6-4cdc-957d-3b6c779dac1b service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:06:27.993480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dffeba-cbfd-4fc1-89c7-8b73e7e268af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:06:27.994036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dffeba-cbfd-4fc1-89c7-8b73e7e268af service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:06:27.994316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dffeba-cbfd-4fc1-89c7-8b73e7e268af service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:06:27.994586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dffeba-cbfd-4fc1-89c7-8b73e7e268af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:06:27.996917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c0dffeba-cbfd-4fc1-89c7-8b73e7e268af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:28.006976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dffeba-cbfd-4fc1-89c7-8b73e7e268af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:06:28.008405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dffeba-cbfd-4fc1-89c7-8b73e7e268af service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:06:28.016945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1162/2317] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:06:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:06:34.738780 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9dd67-7927-4d65-96e8-90cb1214f101 service placement] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:06:34.753754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9dd67-7927-4d65-96e8-90cb1214f101 service placement] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:06:34.759799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0a8d5-b76f-4a57-83f1-fcb0624bcad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:06:34.760415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a8d5-b76f-4a57-83f1-fcb0624bcad5 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:06:34.760686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a8d5-b76f-4a57-83f1-fcb0624bcad5 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:06:34.760951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0a8d5-b76f-4a57-83f1-fcb0624bcad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:06:34.763295 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a6a0a8d5-b76f-4a57-83f1-fcb0624bcad5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:34.776875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0a8d5-b76f-4a57-83f1-fcb0624bcad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:06:34.780253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0a8d5-b76f-4a57-83f1-fcb0624bcad5 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:06:34.790905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1156/2318] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:06:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:06:38.012976 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=18 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:44.786423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=41 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:51.102419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dffeba-cbfd-4fc1-89c7-8b73e7e268af service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:06:51.115289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dffeba-cbfd-4fc1-89c7-8b73e7e268af service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:06:51.123026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59465847-d4c6-4515-bf20-6b063e9bd923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:06:51.123026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59465847-d4c6-4515-bf20-6b063e9bd923 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:06:51.123026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59465847-d4c6-4515-bf20-6b063e9bd923 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:06:51.123026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59465847-d4c6-4515-bf20-6b063e9bd923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:06:51.123428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-59465847-d4c6-4515-bf20-6b063e9bd923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:51.181158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59465847-d4c6-4515-bf20-6b063e9bd923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:06:51.182620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59465847-d4c6-4515-bf20-6b063e9bd923 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:06:51.191633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1163/2319] 10.222.0.77 () {60 vars in 1396 bytes} [Wed Aug 10 23:06:51 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:06:56.612346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0a8d5-b76f-4a57-83f1-fcb0624bcad5 service nova] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:06:56.613790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a6a0a8d5-b76f-4a57-83f1-fcb0624bcad5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:56.673679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0a8d5-b76f-4a57-83f1-fcb0624bcad5 service nova] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:06:56.677258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb2df7-9be1-46c9-8499-552b8049621f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:06:56.677910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb2df7-9be1-46c9-8499-552b8049621f service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:06:56.678214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb2df7-9be1-46c9-8499-552b8049621f service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:06:56.678477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb2df7-9be1-46c9-8499-552b8049621f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:06:56.680150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e2fb2df7-9be1-46c9-8499-552b8049621f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:06:56.741495 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb2df7-9be1-46c9-8499-552b8049621f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:06:56.742941 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb2df7-9be1-46c9-8499-552b8049621f service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:06:56.753519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1157/2320] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:06:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:01.187307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=28 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:06.748869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=48 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:09.059020 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946cec9-8280-402f-a68f-8387786b16ad None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:09.060207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946cec9-8280-402f-a68f-8387786b16ad None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:09.060207 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946cec9-8280-402f-a68f-8387786b16ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:09.079086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4946cec9-8280-402f-a68f-8387786b16ad None None] MFA Rules not processed for user `4d58c48313b74f1685c99cb841e2646d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:09.080286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4946cec9-8280-402f-a68f-8387786b16ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:09.087192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1164/2321] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:09.198126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb2df7-9be1-46c9-8499-552b8049621f service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:09.208019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb2df7-9be1-46c9-8499-552b8049621f service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:09.211635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e482fd-9c3e-47c5-a54c-0a03cda7070a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:09.212232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e482fd-9c3e-47c5-a54c-0a03cda7070a service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:09.212772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e482fd-9c3e-47c5-a54c-0a03cda7070a service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:09.213068 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e482fd-9c3e-47c5-a54c-0a03cda7070a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:09.214808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f7e482fd-9c3e-47c5-a54c-0a03cda7070a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:09.225148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e482fd-9c3e-47c5-a54c-0a03cda7070a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:09.226655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e482fd-9c3e-47c5-a54c-0a03cda7070a service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:09.237954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1158/2322] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:09.712045 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300a06-16e8-424d-b022-d395fe57766a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:09.712596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300a06-16e8-424d-b022-d395fe57766a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:09.713135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300a06-16e8-424d-b022-d395fe57766a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:09.714502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1165/2323] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:07:09.721741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b4127-f1c1-4128-915b-0bc01c80ef2f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:09.722023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b4127-f1c1-4128-915b-0bc01c80ef2f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:09.722292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b4127-f1c1-4128-915b-0bc01c80ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:09.746244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-583b4127-f1c1-4128-915b-0bc01c80ef2f None None] MFA Rules not processed for user `ff5c08bfc5e94b65bd4addde267e4598`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:09.748431 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-583b4127-f1c1-4128-915b-0bc01c80ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:09.755558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1159/2324] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:07:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:09.768150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f300a06-16e8-424d-b022-d395fe57766a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:09.780854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f300a06-16e8-424d-b022-d395fe57766a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:09.785416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259f608-af62-4f68-8732-348eae1edabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:09.791663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259f608-af62-4f68-8732-348eae1edabe service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:09.791663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259f608-af62-4f68-8732-348eae1edabe service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:09.791663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259f608-af62-4f68-8732-348eae1edabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:09.794521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259f608-af62-4f68-8732-348eae1edabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:09.796053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259f608-af62-4f68-8732-348eae1edabe service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:09.804464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1166/2325] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:09.889770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2502-832d-4a17-943c-63d8a19cf987 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:09.890322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2502-832d-4a17-943c-63d8a19cf987 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:09.890794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2502-832d-4a17-943c-63d8a19cf987 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:09.892566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1160/2326] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:07:09.913895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcaa85-69b1-482c-8073-837e27661765 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:09.914176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcaa85-69b1-482c-8073-837e27661765 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:09.914748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcaa85-69b1-482c-8073-837e27661765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:09.937580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1fdcaa85-69b1-482c-8073-837e27661765 None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:09.939014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1fdcaa85-69b1-482c-8073-837e27661765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:09.950027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1167/2327] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:07:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:09.969943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2502-832d-4a17-943c-63d8a19cf987 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:09.988274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2502-832d-4a17-943c-63d8a19cf987 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:09.993384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c59725-17c1-4d1b-9f3d-5b3c9860d31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:09.995054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c59725-17c1-4d1b-9f3d-5b3c9860d31d service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:09.995571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c59725-17c1-4d1b-9f3d-5b3c9860d31d service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:09.995880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c59725-17c1-4d1b-9f3d-5b3c9860d31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:10.017089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c59725-17c1-4d1b-9f3d-5b3c9860d31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:10.018543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c59725-17c1-4d1b-9f3d-5b3c9860d31d service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:10.030297 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1161/2328] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:10.321357 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450ee6-52bc-418d-915f-829cf8bd86ae None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:10.323998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450ee6-52bc-418d-915f-829cf8bd86ae None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:10.323998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0450ee6-52bc-418d-915f-829cf8bd86ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:10.343147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e0450ee6-52bc-418d-915f-829cf8bd86ae None None] MFA Rules not processed for user `03403068f7da491499f2a62ad218159e`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:10.344575 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e0450ee6-52bc-418d-915f-829cf8bd86ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:10.351926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1168/2329] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:19.102047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c59725-17c1-4d1b-9f3d-5b3c9860d31d service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:19.113925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c59725-17c1-4d1b-9f3d-5b3c9860d31d service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:19.119618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d618f-2478-4b4f-857b-464a450d7de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:19.120232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d618f-2478-4b4f-857b-464a450d7de1 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:19.120503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d618f-2478-4b4f-857b-464a450d7de1 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:19.120767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d618f-2478-4b4f-857b-464a450d7de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:19.122504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-921d618f-2478-4b4f-857b-464a450d7de1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:19.135569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d618f-2478-4b4f-857b-464a450d7de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:19.137201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d618f-2478-4b4f-857b-464a450d7de1 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:19.148407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1162/2330] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:20.336337 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=15 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:29.143382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=21 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:30.143940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0450ee6-52bc-418d-915f-829cf8bd86ae None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:30.153370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0450ee6-52bc-418d-915f-829cf8bd86ae None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:30.156918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c34e-8951-4073-b477-c720ab52b96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:30.157824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c34e-8951-4073-b477-c720ab52b96a service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:30.157824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c34e-8951-4073-b477-c720ab52b96a service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:30.158053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c34e-8951-4073-b477-c720ab52b96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:30.159809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c7e2c34e-8951-4073-b477-c720ab52b96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:30.224029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2c34e-8951-4073-b477-c720ab52b96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:30.225487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2c34e-8951-4073-b477-c720ab52b96a service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:30.235558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1169/2331] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:34.273832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d618f-2478-4b4f-857b-464a450d7de1 service nova] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:34.275399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-921d618f-2478-4b4f-857b-464a450d7de1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:34.289163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d618f-2478-4b4f-857b-464a450d7de1 service nova] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:34.294384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023d726-5768-4e7e-ae0c-6c5331323b4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:34.295215 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023d726-5768-4e7e-ae0c-6c5331323b4c service placement] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:34.295488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023d726-5768-4e7e-ae0c-6c5331323b4c service placement] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:34.297433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023d726-5768-4e7e-ae0c-6c5331323b4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:34.297622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3023d726-5768-4e7e-ae0c-6c5331323b4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:34.317924 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023d726-5768-4e7e-ae0c-6c5331323b4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:34.319640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023d726-5768-4e7e-ae0c-6c5331323b4c service placement] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:34.330724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1163/2332] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:34.409357 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c34e-8951-4073-b477-c720ab52b96a service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:34.411469 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c7e2c34e-8951-4073-b477-c720ab52b96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:34.424663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c34e-8951-4073-b477-c720ab52b96a service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:34.430648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:34.430648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:34.430648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:34.430648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] PATH_INFO: `/v3/users/6cbf62d3f1b44cf582da2659ef133e30` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:34.431671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbf62d3f1b44cf582da2659ef133e30)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:34.433581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:34.604459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbf62d3f1b44cf582da2659ef133e30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:34.619465 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbf62d3f1b44cf582da2659ef133e30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:34.620214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbf62d3f1b44cf582da2659ef133e30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:34.620823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbf62d3f1b44cf582da2659ef133e30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:34.721244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9d7397a7-f0b0-405e-a8c9-31d3e1fadf2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbf62d3f1b44cf582da2659ef133e30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:34.736010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1170/2333] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:07:34 2022] DELETE /identity/v3/users/6cbf62d3f1b44cf582da2659ef133e30 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:35.002568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023d726-5768-4e7e-ae0c-6c5331323b4c service placement] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:35.028735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023d726-5768-4e7e-ae0c-6c5331323b4c service placement] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:35.097126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:35.097858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:35.098202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:35.098547 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] PATH_INFO: `/v3/projects/530d3235232a48c6b61fb3b54e03c11c` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:35.099856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] RBAC: Authorizing `identity:delete_project(project_id=530d3235232a48c6b61fb3b54e03c11c)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:35.103142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:35.222772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530d3235232a48c6b61fb3b54e03c11c', 'request_id': 'req-a11eb38b-31d4-4a58-8d74-e969d557877a'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:35.232592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530d3235232a48c6b61fb3b54e03c11c', 'request_id': 'req-a11eb38b-31d4-4a58-8d74-e969d557877a'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:35.313474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530d3235232a48c6b61fb3b54e03c11c', 'request_id': 'req-a11eb38b-31d4-4a58-8d74-e969d557877a'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:35.328322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] The token cache is being invalidate because project 530d3235232a48c6b61fb3b54e03c11c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:07:35.328611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:35.329328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-a11eb38b-31d4-4a58-8d74-e969d557877a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:35.338885 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1164/2334] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:35 2022] DELETE /identity/v3/projects/530d3235232a48c6b61fb3b54e03c11c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:35.343619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c22e0-1327-4c5a-a4a1-facbabc63a66 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:35.344124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c22e0-1327-4c5a-a4a1-facbabc63a66 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:35.344566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c22e0-1327-4c5a-a4a1-facbabc63a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:35.366819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7f8c22e0-1327-4c5a-a4a1-facbabc63a66 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:35.368592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7f8c22e0-1327-4c5a-a4a1-facbabc63a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:35.443143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1171/2335] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:35.451162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8c3fb-d532-4d35-a99d-0f10c1b17471 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:35.451445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8c3fb-d532-4d35-a99d-0f10c1b17471 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:35.451948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8c3fb-d532-4d35-a99d-0f10c1b17471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:35.474757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-0ba8c3fb-d532-4d35-a99d-0f10c1b17471 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:35.475972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-0ba8c3fb-d532-4d35-a99d-0f10c1b17471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:35.485073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1165/2336] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:35.489004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c22e0-1327-4c5a-a4a1-facbabc63a66 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:35.499334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c22e0-1327-4c5a-a4a1-facbabc63a66 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:35.504241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138de29d-208b-4885-a8ac-db07714d9718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:35.505057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138de29d-208b-4885-a8ac-db07714d9718 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:35.505515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138de29d-208b-4885-a8ac-db07714d9718 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:35.505940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138de29d-208b-4885-a8ac-db07714d9718 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:35.506962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138de29d-208b-4885-a8ac-db07714d9718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:07:35.507431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138de29d-208b-4885-a8ac-db07714d9718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:35.509496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138de29d-208b-4885-a8ac-db07714d9718 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:35.511102 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:35.523032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1172/2337] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:07:35.527484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8c3fb-d532-4d35-a99d-0f10c1b17471 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:35.539531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8c3fb-d532-4d35-a99d-0f10c1b17471 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:35.549371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43f9f-5584-4f38-935c-892129fe3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:35.549371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43f9f-5584-4f38-935c-892129fe3b71 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:35.549371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43f9f-5584-4f38-935c-892129fe3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:35.549371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43f9f-5584-4f38-935c-892129fe3b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:35.553244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd43f9f-5584-4f38-935c-892129fe3b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:35.553244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd43f9f-5584-4f38-935c-892129fe3b71 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:35.670734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1166/2338] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:07:35 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:07:35.671245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138de29d-208b-4885-a8ac-db07714d9718 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:35.681408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138de29d-208b-4885-a8ac-db07714d9718 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:35.742823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926ba9d-453c-4b57-88ba-21d3fe9c96df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:35.743442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926ba9d-453c-4b57-88ba-21d3fe9c96df admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:35.743717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926ba9d-453c-4b57-88ba-21d3fe9c96df admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:35.743982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926ba9d-453c-4b57-88ba-21d3fe9c96df admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:35.744613 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926ba9d-453c-4b57-88ba-21d3fe9c96df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:35.746527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926ba9d-453c-4b57-88ba-21d3fe9c96df admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:35.824309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1173/2339] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:07:35 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:07:35.829122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43f9f-5584-4f38-935c-892129fe3b71 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:35.839772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43f9f-5584-4f38-935c-892129fe3b71 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:35.844530 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdb106-acad-461a-856b-2e603aff54ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:35.845132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdb106-acad-461a-856b-2e603aff54ac admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:35.845440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdb106-acad-461a-856b-2e603aff54ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:35.845714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdb106-acad-461a-856b-2e603aff54ac admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:35.846372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdb106-acad-461a-856b-2e603aff54ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:35.847962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdb106-acad-461a-856b-2e603aff54ac admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:35.859366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1167/2340] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:07:35.863491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926ba9d-453c-4b57-88ba-21d3fe9c96df admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:35.874302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926ba9d-453c-4b57-88ba-21d3fe9c96df admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:35.879055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756d989-79de-4d81-b300-274e173a9d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:35.879861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d989-79de-4d81-b300-274e173a9d8b admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:35.880292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d989-79de-4d81-b300-274e173a9d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:35.880568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756d989-79de-4d81-b300-274e173a9d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:35.881215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756d989-79de-4d81-b300-274e173a9d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:35.882853 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756d989-79de-4d81-b300-274e173a9d8b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:35.894259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1174/2341] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:07:35.898605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdb106-acad-461a-856b-2e603aff54ac admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:35.909031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdb106-acad-461a-856b-2e603aff54ac admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:35.913826 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6cb8b-7607-4eb8-a798-5ebe0aeb1c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:35.914481 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6cb8b-7607-4eb8-a798-5ebe0aeb1c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:35.914757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6cb8b-7607-4eb8-a798-5ebe0aeb1c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:35.915023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6cb8b-7607-4eb8-a798-5ebe0aeb1c4e admin admin] PATH_INFO: `/v3/projects/5d01a920c85149ba903b82115dbbdb04/users/ca21bcfc8df940c2ac0063cbf25d06fc/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:35.933741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6cb8b-7607-4eb8-a798-5ebe0aeb1c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d01a920c85149ba903b82115dbbdb04, user_id=ca21bcfc8df940c2ac0063cbf25d06fc, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:35.937001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6cb8b-7607-4eb8-a798-5ebe0aeb1c4e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:36.052862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1168/2342] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:07:35 2022] PUT /identity/v3/projects/5d01a920c85149ba903b82115dbbdb04/users/ca21bcfc8df940c2ac0063cbf25d06fc/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:36.063492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982edf21-261d-4a4d-8ab8-faf033188e43 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:36.063766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982edf21-261d-4a4d-8ab8-faf033188e43 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:36.064035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982edf21-261d-4a4d-8ab8-faf033188e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:36.090837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-982edf21-261d-4a4d-8ab8-faf033188e43 None None] MFA Rules not processed for user `ca21bcfc8df940c2ac0063cbf25d06fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:36.092005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-982edf21-261d-4a4d-8ab8-faf033188e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:36.157261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1175/2343] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:07:36.161969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6cb8b-7607-4eb8-a798-5ebe0aeb1c4e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:36.175893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:36.229746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6cb8b-7607-4eb8-a798-5ebe0aeb1c4e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:36.235196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e74ede-073c-4e22-a29c-f171fd2dd51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:36.235788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74ede-073c-4e22-a29c-f171fd2dd51c admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:36.238426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74ede-073c-4e22-a29c-f171fd2dd51c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:36.238426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74ede-073c-4e22-a29c-f171fd2dd51c admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:36.238426 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e74ede-073c-4e22-a29c-f171fd2dd51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:36.238871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e74ede-073c-4e22-a29c-f171fd2dd51c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:36.308416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1169/2344] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:07:36 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:07:36.312673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982edf21-261d-4a4d-8ab8-faf033188e43 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:36.323134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982edf21-261d-4a4d-8ab8-faf033188e43 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:36.378580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1193e-0fb1-4561-9b67-2e19990bdb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:36.379228 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1193e-0fb1-4561-9b67-2e19990bdb55 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:36.379445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1193e-0fb1-4561-9b67-2e19990bdb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:36.379714 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1193e-0fb1-4561-9b67-2e19990bdb55 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:36.380324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1193e-0fb1-4561-9b67-2e19990bdb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:36.382260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1193e-0fb1-4561-9b67-2e19990bdb55 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:36.390835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:36.492264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1176/2345] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:07:36 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:07:36.496310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e74ede-073c-4e22-a29c-f171fd2dd51c admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:36.506502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e74ede-073c-4e22-a29c-f171fd2dd51c admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:36.511273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e8764-fdcd-4c2d-8d36-c1b7c0b09638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:36.511875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e8764-fdcd-4c2d-8d36-c1b7c0b09638 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:36.512181 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e8764-fdcd-4c2d-8d36-c1b7c0b09638 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:36.512488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e8764-fdcd-4c2d-8d36-c1b7c0b09638 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:36.515043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e8764-fdcd-4c2d-8d36-c1b7c0b09638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:36.517191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e8764-fdcd-4c2d-8d36-c1b7c0b09638 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:36.530558 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1170/2346] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:07:36.534974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1193e-0fb1-4561-9b67-2e19990bdb55 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:36.548312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1193e-0fb1-4561-9b67-2e19990bdb55 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:36.555914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64616-5b21-49b7-8c8e-433028b4e56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:36.556772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64616-5b21-49b7-8c8e-433028b4e56b admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:36.557046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64616-5b21-49b7-8c8e-433028b4e56b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:36.557339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64616-5b21-49b7-8c8e-433028b4e56b admin admin] PATH_INFO: `/v3/projects/f7a999f2a0384911b7c8c23ae6bfa892/users/653c54fc96674cf98d12ae69a1eea6e0/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:36.574286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e64616-5b21-49b7-8c8e-433028b4e56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a999f2a0384911b7c8c23ae6bfa892, user_id=653c54fc96674cf98d12ae69a1eea6e0, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:36.577505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e64616-5b21-49b7-8c8e-433028b4e56b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:36.690822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1177/2347] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:07:36 2022] PUT /identity/v3/projects/f7a999f2a0384911b7c8c23ae6bfa892/users/653c54fc96674cf98d12ae69a1eea6e0/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:36.694930 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e8764-fdcd-4c2d-8d36-c1b7c0b09638 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:36.705268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e8764-fdcd-4c2d-8d36-c1b7c0b09638 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:36.759730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb00865-7759-456b-b44c-d40c5e7e50b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:36.760414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb00865-7759-456b-b44c-d40c5e7e50b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:36.760686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb00865-7759-456b-b44c-d40c5e7e50b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:36.760948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb00865-7759-456b-b44c-d40c5e7e50b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:36.761605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb00865-7759-456b-b44c-d40c5e7e50b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:36.763703 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb00865-7759-456b-b44c-d40c5e7e50b2 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:36.773124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1171/2348] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:07:36.777341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64616-5b21-49b7-8c8e-433028b4e56b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:36.788304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64616-5b21-49b7-8c8e-433028b4e56b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:36.792916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e9d21-d4ef-4c9b-a44e-a8c1c3c176c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:36.793583 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e9d21-d4ef-4c9b-a44e-a8c1c3c176c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:36.793859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e9d21-d4ef-4c9b-a44e-a8c1c3c176c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:36.794126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e9d21-d4ef-4c9b-a44e-a8c1c3c176c8 admin admin] PATH_INFO: `/v3/projects/f7a999f2a0384911b7c8c23ae6bfa892/users/653c54fc96674cf98d12ae69a1eea6e0/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:36.795997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e9d21-d4ef-4c9b-a44e-a8c1c3c176c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a999f2a0384911b7c8c23ae6bfa892, user_id=653c54fc96674cf98d12ae69a1eea6e0, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:36.798638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e9d21-d4ef-4c9b-a44e-a8c1c3c176c8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:36.808622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1178/2349] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:07:36 2022] PUT /identity/v3/projects/f7a999f2a0384911b7c8c23ae6bfa892/users/653c54fc96674cf98d12ae69a1eea6e0/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:36.820160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1bb6-d0c9-47b8-b1e0-61d470636065 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:36.820442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1bb6-d0c9-47b8-b1e0-61d470636065 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:36.820712 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1bb6-d0c9-47b8-b1e0-61d470636065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:36.849144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-a32a1bb6-d0c9-47b8-b1e0-61d470636065 None None] MFA Rules not processed for user `653c54fc96674cf98d12ae69a1eea6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:36.850369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a32a1bb6-d0c9-47b8-b1e0-61d470636065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:36.920969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1172/2350] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:36.932202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e9d21-d4ef-4c9b-a44e-a8c1c3c176c8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:36.933951 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b18e9d21-d4ef-4c9b-a44e-a8c1c3c176c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:36.991611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e9d21-d4ef-4c9b-a44e-a8c1c3c176c8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:36.995198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606036d-a43e-4687-ada8-e7b242903d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:36.995783 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606036d-a43e-4687-ada8-e7b242903d2e service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:36.996058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606036d-a43e-4687-ada8-e7b242903d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:36.996324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606036d-a43e-4687-ada8-e7b242903d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:37.005679 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606036d-a43e-4687-ada8-e7b242903d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:37.007096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606036d-a43e-4687-ada8-e7b242903d2e service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:37.016899 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1179/2351] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:37.116131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a1bb6-d0c9-47b8-b1e0-61d470636065 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:37.126088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a1bb6-d0c9-47b8-b1e0-61d470636065 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:37.129577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da9156-26f9-4164-9cc3-8d9d9d0b36d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:37.130154 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da9156-26f9-4164-9cc3-8d9d9d0b36d4 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:37.130422 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da9156-26f9-4164-9cc3-8d9d9d0b36d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:37.130686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da9156-26f9-4164-9cc3-8d9d9d0b36d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:37.135565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:37.187784 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da9156-26f9-4164-9cc3-8d9d9d0b36d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:37.189189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da9156-26f9-4164-9cc3-8d9d9d0b36d4 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:37.198533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1173/2352] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:40.228291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606036d-a43e-4687-ada8-e7b242903d2e service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:40.287619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606036d-a43e-4687-ada8-e7b242903d2e service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:40.292074 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:40.292683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:40.292984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:40.293250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] PATH_INFO: `/v3/users/ca21bcfc8df940c2ac0063cbf25d06fc` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:40.295021 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca21bcfc8df940c2ac0063cbf25d06fc)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:40.296913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:40.522720 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca21bcfc8df940c2ac0063cbf25d06fc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:40.531169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:40.537657 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca21bcfc8df940c2ac0063cbf25d06fc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:40.538757 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca21bcfc8df940c2ac0063cbf25d06fc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:40.539758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca21bcfc8df940c2ac0063cbf25d06fc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:40.629559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca21bcfc8df940c2ac0063cbf25d06fc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:40.642519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1180/2353] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:07:40 2022] DELETE /identity/v3/users/ca21bcfc8df940c2ac0063cbf25d06fc => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:40.647131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237fa88-0394-4726-8777-12caa7460d95 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:40.647577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237fa88-0394-4726-8777-12caa7460d95 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:40.647727 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237fa88-0394-4726-8777-12caa7460d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:40.666725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c237fa88-0394-4726-8777-12caa7460d95 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:40.667907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c237fa88-0394-4726-8777-12caa7460d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:40.724903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1174/2354] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:40.734478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:40.735862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:40.792023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff954f36-0327-484d-aee9-be73b962564e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:40.795620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4a7d-05a5-4e6b-b877-5c710f4c0022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:40.796213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4a7d-05a5-4e6b-b877-5c710f4c0022 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:40.796487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4a7d-05a5-4e6b-b877-5c710f4c0022 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:40.796754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4a7d-05a5-4e6b-b877-5c710f4c0022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:40.805582 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f4a7d-05a5-4e6b-b877-5c710f4c0022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:40.807006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f4a7d-05a5-4e6b-b877-5c710f4c0022 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:40.816809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1181/2355] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:41.168141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237fa88-0394-4726-8777-12caa7460d95 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:41.170077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c237fa88-0394-4726-8777-12caa7460d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:41.181889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237fa88-0394-4726-8777-12caa7460d95 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:41.187413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:41.188087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:41.188375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:41.188641 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] PATH_INFO: `/v3/projects/5d01a920c85149ba903b82115dbbdb04` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:41.189809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d01a920c85149ba903b82115dbbdb04)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:41.191734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:41.268953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d01a920c85149ba903b82115dbbdb04', 'request_id': 'req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:41.275103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d01a920c85149ba903b82115dbbdb04', 'request_id': 'req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:41.331872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d01a920c85149ba903b82115dbbdb04', 'request_id': 'req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:41.342272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] The token cache is being invalidate because project 5d01a920c85149ba903b82115dbbdb04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:07:41.342554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:41.343162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:41.344618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1175/2356] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:41 2022] DELETE /identity/v3/projects/5d01a920c85149ba903b82115dbbdb04 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:41.348656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4a7d-05a5-4e6b-b877-5c710f4c0022 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:41.358624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4a7d-05a5-4e6b-b877-5c710f4c0022 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:41.416327 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:41.416951 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:41.417253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:41.417616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] PATH_INFO: `/v3/users/653c54fc96674cf98d12ae69a1eea6e0` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:41.419292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=653c54fc96674cf98d12ae69a1eea6e0)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:41.421201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:41.592535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '653c54fc96674cf98d12ae69a1eea6e0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:41.604447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '653c54fc96674cf98d12ae69a1eea6e0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:41.605133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '653c54fc96674cf98d12ae69a1eea6e0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:41.605836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '653c54fc96674cf98d12ae69a1eea6e0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:41.652184 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5c40a353-058d-4b1d-9fdd-1e7d03891a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '653c54fc96674cf98d12ae69a1eea6e0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:41.660438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:41.665385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1182/2357] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:07:41 2022] DELETE /identity/v3/users/653c54fc96674cf98d12ae69a1eea6e0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:42.110749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:42.112202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:42.125273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadf157-0fd7-45a4-9aa0-ec7952abd0f0 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:42.155574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:42.181739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:42.182356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:42.182629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:42.182884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] PATH_INFO: `/v3/projects/f7a999f2a0384911b7c8c23ae6bfa892` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:42.183979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a999f2a0384911b7c8c23ae6bfa892)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:42.185939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:42.291372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a999f2a0384911b7c8c23ae6bfa892', 'request_id': 'req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:42.297391 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a999f2a0384911b7c8c23ae6bfa892', 'request_id': 'req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:42.404311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a999f2a0384911b7c8c23ae6bfa892', 'request_id': 'req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:42.414613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] The token cache is being invalidate because project f7a999f2a0384911b7c8c23ae6bfa892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:07:42.414904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:42.415517 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9b64432b-9ba3-42bc-bf35-6e5eefa9a5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:42.417081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1176/2358] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:42 2022] DELETE /identity/v3/projects/f7a999f2a0384911b7c8c23ae6bfa892 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:42.421922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034aaf-39ec-4cc7-a736-f04099ee906c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:42.422394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034aaf-39ec-4cc7-a736-f04099ee906c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:42.422499 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034aaf-39ec-4cc7-a736-f04099ee906c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:42.442293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e4034aaf-39ec-4cc7-a736-f04099ee906c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:42.443595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e4034aaf-39ec-4cc7-a736-f04099ee906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:42.501638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1183/2359] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:07:42.509238 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849159a-5e7b-4808-9460-cc2f4dea86dd None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:42.509551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849159a-5e7b-4808-9460-cc2f4dea86dd None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:42.509827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849159a-5e7b-4808-9460-cc2f4dea86dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:42.530189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-d849159a-5e7b-4808-9460-cc2f4dea86dd None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:42.531579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-d849159a-5e7b-4808-9460-cc2f4dea86dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:42.541543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1177/2360] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:42.545951 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034aaf-39ec-4cc7-a736-f04099ee906c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:42.556264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034aaf-39ec-4cc7-a736-f04099ee906c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:42.561909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f00f4-57ba-4551-837f-b10d29b0eb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:42.562504 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f00f4-57ba-4551-837f-b10d29b0eb6d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:42.562782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f00f4-57ba-4551-837f-b10d29b0eb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:42.563134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f00f4-57ba-4551-837f-b10d29b0eb6d admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:42.563785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f00f4-57ba-4551-837f-b10d29b0eb6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:07:42.564084 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f00f4-57ba-4551-837f-b10d29b0eb6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:42.565717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f00f4-57ba-4551-837f-b10d29b0eb6d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:42.578067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1184/2361] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:07:42.582501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849159a-5e7b-4808-9460-cc2f4dea86dd None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:42.591952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849159a-5e7b-4808-9460-cc2f4dea86dd None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:42.596473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2101e-b41b-4b82-90f7-a885d1c35653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:42.597057 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2101e-b41b-4b82-90f7-a885d1c35653 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:42.597365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2101e-b41b-4b82-90f7-a885d1c35653 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:42.597635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2101e-b41b-4b82-90f7-a885d1c35653 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:42.598249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2101e-b41b-4b82-90f7-a885d1c35653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:42.600230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2101e-b41b-4b82-90f7-a885d1c35653 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:42.699825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1178/2362] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:07:42 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:07:42.701821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f00f4-57ba-4551-837f-b10d29b0eb6d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:42.711940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f00f4-57ba-4551-837f-b10d29b0eb6d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:42.768033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5bb38-164a-47da-b725-a2add1751c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:42.768619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5bb38-164a-47da-b725-a2add1751c2e admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:42.768894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5bb38-164a-47da-b725-a2add1751c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:42.769162 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5bb38-164a-47da-b725-a2add1751c2e admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:42.769806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5bb38-164a-47da-b725-a2add1751c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:42.771699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5bb38-164a-47da-b725-a2add1751c2e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:42.858309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1185/2363] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:07:42 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:07:42.862349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2101e-b41b-4b82-90f7-a885d1c35653 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:42.873184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2101e-b41b-4b82-90f7-a885d1c35653 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:42.877813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed443b-3c3f-45ec-a089-f13a7e04c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:42.878404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed443b-3c3f-45ec-a089-f13a7e04c139 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:42.878679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed443b-3c3f-45ec-a089-f13a7e04c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:42.878951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed443b-3c3f-45ec-a089-f13a7e04c139 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:42.879594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed443b-3c3f-45ec-a089-f13a7e04c139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:42.881183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed443b-3c3f-45ec-a089-f13a7e04c139 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:42.890936 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1179/2364] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:07:42.895480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5bb38-164a-47da-b725-a2add1751c2e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:42.906967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5bb38-164a-47da-b725-a2add1751c2e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:42.912208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741d8d0-cedc-497e-a80b-090a84ee4473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:42.912208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741d8d0-cedc-497e-a80b-090a84ee4473 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:42.912465 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741d8d0-cedc-497e-a80b-090a84ee4473 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:42.912762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741d8d0-cedc-497e-a80b-090a84ee4473 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:42.913500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741d8d0-cedc-497e-a80b-090a84ee4473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:42.914909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741d8d0-cedc-497e-a80b-090a84ee4473 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:42.926530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1186/2365] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:07:42.933386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed443b-3c3f-45ec-a089-f13a7e04c139 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:42.944060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed443b-3c3f-45ec-a089-f13a7e04c139 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:42.948870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e8647-cc25-44bf-86fd-b3a67e688bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:42.949567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8647-cc25-44bf-86fd-b3a67e688bce admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:42.949891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8647-cc25-44bf-86fd-b3a67e688bce admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:42.950104 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8647-cc25-44bf-86fd-b3a67e688bce admin admin] PATH_INFO: `/v3/projects/bdfb3d66f6fb4e188288b1bac3e80b5c/users/7398007f35d145d09b6f50e71c20d7d4/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:42.964484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e8647-cc25-44bf-86fd-b3a67e688bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfb3d66f6fb4e188288b1bac3e80b5c, user_id=7398007f35d145d09b6f50e71c20d7d4, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:42.967644 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e8647-cc25-44bf-86fd-b3a67e688bce admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:43.056160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1180/2366] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:07:42 2022] PUT /identity/v3/projects/bdfb3d66f6fb4e188288b1bac3e80b5c/users/7398007f35d145d09b6f50e71c20d7d4/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:43.067827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a63ea9-f3c3-49f7-a1c3-50e82fda22bc None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:43.068110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a63ea9-f3c3-49f7-a1c3-50e82fda22bc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:43.068425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a63ea9-f3c3-49f7-a1c3-50e82fda22bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:43.095962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-25a63ea9-f3c3-49f7-a1c3-50e82fda22bc None None] MFA Rules not processed for user `7398007f35d145d09b6f50e71c20d7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:43.097147 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-25a63ea9-f3c3-49f7-a1c3-50e82fda22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:43.149098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:43.159408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1187/2367] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:43.169907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e8647-cc25-44bf-86fd-b3a67e688bce admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:43.227125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:43.230734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e8647-cc25-44bf-86fd-b3a67e688bce admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:43.235933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168cbb9-5430-47d1-b259-45ecfc0df158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:43.236521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168cbb9-5430-47d1-b259-45ecfc0df158 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:43.236797 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168cbb9-5430-47d1-b259-45ecfc0df158 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:43.237065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168cbb9-5430-47d1-b259-45ecfc0df158 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:43.240596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168cbb9-5430-47d1-b259-45ecfc0df158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:43.240596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168cbb9-5430-47d1-b259-45ecfc0df158 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:43.315920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1181/2368] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:07:43 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:07:43.320101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a63ea9-f3c3-49f7-a1c3-50e82fda22bc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:43.331333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a63ea9-f3c3-49f7-a1c3-50e82fda22bc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:43.387835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4b44d-ff04-4ea0-9799-6d4fc4c65b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:43.388438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4b44d-ff04-4ea0-9799-6d4fc4c65b03 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:43.388711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4b44d-ff04-4ea0-9799-6d4fc4c65b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:43.388978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4b44d-ff04-4ea0-9799-6d4fc4c65b03 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:43.389619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4b44d-ff04-4ea0-9799-6d4fc4c65b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:43.391508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4b44d-ff04-4ea0-9799-6d4fc4c65b03 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:43.486249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1188/2369] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:07:43 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:07:43.490117 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168cbb9-5430-47d1-b259-45ecfc0df158 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:43.500167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168cbb9-5430-47d1-b259-45ecfc0df158 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:43.504639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6753f-0ad9-49bd-8f72-a9d7ea42ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:43.506328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6753f-0ad9-49bd-8f72-a9d7ea42ee3c admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:43.506328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6753f-0ad9-49bd-8f72-a9d7ea42ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:43.506328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6753f-0ad9-49bd-8f72-a9d7ea42ee3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:43.506573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6753f-0ad9-49bd-8f72-a9d7ea42ee3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:43.508006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6753f-0ad9-49bd-8f72-a9d7ea42ee3c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:43.518272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1182/2370] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:07:43.522231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4b44d-ff04-4ea0-9799-6d4fc4c65b03 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:43.532918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4b44d-ff04-4ea0-9799-6d4fc4c65b03 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:43.537579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab482d6a-86fb-48ee-894f-564eef7f6457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:43.538106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab482d6a-86fb-48ee-894f-564eef7f6457 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:43.538379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab482d6a-86fb-48ee-894f-564eef7f6457 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:43.538650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab482d6a-86fb-48ee-894f-564eef7f6457 admin admin] PATH_INFO: `/v3/projects/d3ed01ffb3c54588a521a88bfa3af05e/users/789d47945e0b4dcf91d08e78ce43a9c3/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:43.553715 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab482d6a-86fb-48ee-894f-564eef7f6457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ed01ffb3c54588a521a88bfa3af05e, user_id=789d47945e0b4dcf91d08e78ce43a9c3, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:43.556342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab482d6a-86fb-48ee-894f-564eef7f6457 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:43.621493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1189/2371] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:07:43 2022] PUT /identity/v3/projects/d3ed01ffb3c54588a521a88bfa3af05e/users/789d47945e0b4dcf91d08e78ce43a9c3/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:43.625445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6753f-0ad9-49bd-8f72-a9d7ea42ee3c admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:43.635286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6753f-0ad9-49bd-8f72-a9d7ea42ee3c admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:43.691679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddba9f7-1489-4448-8e8c-4c2b2043b69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:43.699904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddba9f7-1489-4448-8e8c-4c2b2043b69d admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:43.699904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddba9f7-1489-4448-8e8c-4c2b2043b69d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:43.699904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddba9f7-1489-4448-8e8c-4c2b2043b69d admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:43.699904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddba9f7-1489-4448-8e8c-4c2b2043b69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:43.699904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddba9f7-1489-4448-8e8c-4c2b2043b69d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:43.709039 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1183/2372] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:07:43.729789 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab482d6a-86fb-48ee-894f-564eef7f6457 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:43.742040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab482d6a-86fb-48ee-894f-564eef7f6457 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:43.747412 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b581f9-d397-4bd4-af74-776cd31ec9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:43.747925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b581f9-d397-4bd4-af74-776cd31ec9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:43.748857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b581f9-d397-4bd4-af74-776cd31ec9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:43.749432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b581f9-d397-4bd4-af74-776cd31ec9d6 admin admin] PATH_INFO: `/v3/projects/d3ed01ffb3c54588a521a88bfa3af05e/users/789d47945e0b4dcf91d08e78ce43a9c3/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:43.751558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b581f9-d397-4bd4-af74-776cd31ec9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ed01ffb3c54588a521a88bfa3af05e, user_id=789d47945e0b4dcf91d08e78ce43a9c3, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:43.754750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b581f9-d397-4bd4-af74-776cd31ec9d6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:43.767057 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1190/2373] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:07:43 2022] PUT /identity/v3/projects/d3ed01ffb3c54588a521a88bfa3af05e/users/789d47945e0b4dcf91d08e78ce43a9c3/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:43.779484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847b800-c492-44f1-b48c-8c118d6b4569 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:43.779788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847b800-c492-44f1-b48c-8c118d6b4569 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:43.780081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847b800-c492-44f1-b48c-8c118d6b4569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:43.807744 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9847b800-c492-44f1-b48c-8c118d6b4569 None None] MFA Rules not processed for user `789d47945e0b4dcf91d08e78ce43a9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:43.808920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9847b800-c492-44f1-b48c-8c118d6b4569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:43.874869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1184/2374] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:07:43.885911 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b581f9-d397-4bd4-af74-776cd31ec9d6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:43.887721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d1b581f9-d397-4bd4-af74-776cd31ec9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:43.944132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b581f9-d397-4bd4-af74-776cd31ec9d6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:43.947807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6cb7f-0e5b-4e38-a2b1-25c1c019d288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:43.948408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6cb7f-0e5b-4e38-a2b1-25c1c019d288 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:43.948689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6cb7f-0e5b-4e38-a2b1-25c1c019d288 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:43.948961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6cb7f-0e5b-4e38-a2b1-25c1c019d288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:43.958476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6cb7f-0e5b-4e38-a2b1-25c1c019d288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:43.959929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6cb7f-0e5b-4e38-a2b1-25c1c019d288 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:43.969507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1191/2375] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:44.204540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847b800-c492-44f1-b48c-8c118d6b4569 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:44.214566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847b800-c492-44f1-b48c-8c118d6b4569 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:44.218145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56591f1-e98c-43b7-8aef-cc2d48d891e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:44.218725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56591f1-e98c-43b7-8aef-cc2d48d891e6 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:44.218994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56591f1-e98c-43b7-8aef-cc2d48d891e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:44.219258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56591f1-e98c-43b7-8aef-cc2d48d891e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:44.268021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:44.276597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56591f1-e98c-43b7-8aef-cc2d48d891e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:44.278061 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56591f1-e98c-43b7-8aef-cc2d48d891e6 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:44.287084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1185/2376] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:50.620080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6cb7f-0e5b-4e38-a2b1-25c1c019d288 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:50.666692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:50.680442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6cb7f-0e5b-4e38-a2b1-25c1c019d288 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:50.684935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:50.685627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:50.685904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:50.686216 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] PATH_INFO: `/v3/users/7398007f35d145d09b6f50e71c20d7d4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:50.687341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7398007f35d145d09b6f50e71c20d7d4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:50.689250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:50.870418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7398007f35d145d09b6f50e71c20d7d4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:50.882078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7398007f35d145d09b6f50e71c20d7d4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:50.884845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7398007f35d145d09b6f50e71c20d7d4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:50.884845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7398007f35d145d09b6f50e71c20d7d4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:50.954836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7398007f35d145d09b6f50e71c20d7d4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:50.968028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1192/2377] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:07:50 2022] DELETE /identity/v3/users/7398007f35d145d09b6f50e71c20d7d4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:50.972511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512812a0-530c-4957-8d14-9d2c27722600 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:50.972965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512812a0-530c-4957-8d14-9d2c27722600 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:50.973076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512812a0-530c-4957-8d14-9d2c27722600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:50.992507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-512812a0-530c-4957-8d14-9d2c27722600 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:50.993212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-512812a0-530c-4957-8d14-9d2c27722600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:51.054839 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1186/2378] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:51.062096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:51.065937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:51.119759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d2bf5-1397-4d9b-8016-aca98401b9bb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:51.123923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791b9c8-4b8d-4276-9140-ec9620658493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:51.124469 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791b9c8-4b8d-4276-9140-ec9620658493 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:51.124734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791b9c8-4b8d-4276-9140-ec9620658493 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:51.124998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791b9c8-4b8d-4276-9140-ec9620658493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:51.134203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791b9c8-4b8d-4276-9140-ec9620658493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:51.135665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791b9c8-4b8d-4276-9140-ec9620658493 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:51.145701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1193/2379] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:51.545787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512812a0-530c-4957-8d14-9d2c27722600 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:51.547600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-512812a0-530c-4957-8d14-9d2c27722600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:51.564158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512812a0-530c-4957-8d14-9d2c27722600 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:51.569468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:51.570138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:51.570437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:51.570663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] PATH_INFO: `/v3/projects/bdfb3d66f6fb4e188288b1bac3e80b5c` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:51.571766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfb3d66f6fb4e188288b1bac3e80b5c)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:51.573769 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:51.698894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfb3d66f6fb4e188288b1bac3e80b5c', 'request_id': 'req-1b71e807-95c1-4c56-ad99-3ff98e9c5359'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:51.705175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfb3d66f6fb4e188288b1bac3e80b5c', 'request_id': 'req-1b71e807-95c1-4c56-ad99-3ff98e9c5359'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:51.777970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfb3d66f6fb4e188288b1bac3e80b5c', 'request_id': 'req-1b71e807-95c1-4c56-ad99-3ff98e9c5359'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:51.788444 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] The token cache is being invalidate because project bdfb3d66f6fb4e188288b1bac3e80b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:07:51.788730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:51.789381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:51.790857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1187/2380] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:51 2022] DELETE /identity/v3/projects/bdfb3d66f6fb4e188288b1bac3e80b5c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:51.794806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791b9c8-4b8d-4276-9140-ec9620658493 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:51.804950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791b9c8-4b8d-4276-9140-ec9620658493 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:51.859312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:51.859918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:51.860195 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:51.860464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] PATH_INFO: `/v3/users/789d47945e0b4dcf91d08e78ce43a9c3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:51.861588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=789d47945e0b4dcf91d08e78ce43a9c3)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:51.863529 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:51.876971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:52.026926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789d47945e0b4dcf91d08e78ce43a9c3'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:52.039314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789d47945e0b4dcf91d08e78ce43a9c3'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:52.040093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789d47945e0b4dcf91d08e78ce43a9c3'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:52.040691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789d47945e0b4dcf91d08e78ce43a9c3'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:52.120584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f49cafb2-6245-41ac-885a-f5551abfa93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789d47945e0b4dcf91d08e78ce43a9c3'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:52.132805 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1194/2381] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:07:51 2022] DELETE /identity/v3/users/789d47945e0b4dcf91d08e78ce43a9c3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:52.528428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:52.529903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:52.542837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71e807-95c1-4c56-ad99-3ff98e9c5359 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:52.613256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:52.613905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:52.614182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:52.614452 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] PATH_INFO: `/v3/projects/d3ed01ffb3c54588a521a88bfa3af05e` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:52.615570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ed01ffb3c54588a521a88bfa3af05e)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:52.617489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:52.634352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:52.701920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ed01ffb3c54588a521a88bfa3af05e', 'request_id': 'req-930b3518-3103-4a77-8e6a-05bdf4a206f2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:52.708039 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ed01ffb3c54588a521a88bfa3af05e', 'request_id': 'req-930b3518-3103-4a77-8e6a-05bdf4a206f2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:52.770191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ed01ffb3c54588a521a88bfa3af05e', 'request_id': 'req-930b3518-3103-4a77-8e6a-05bdf4a206f2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:52.780892 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] The token cache is being invalidate because project d3ed01ffb3c54588a521a88bfa3af05e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:07:52.781179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:52.781841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-930b3518-3103-4a77-8e6a-05bdf4a206f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:07:52.783304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1188/2382] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:52 2022] DELETE /identity/v3/projects/d3ed01ffb3c54588a521a88bfa3af05e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:52.788323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7014ed-2613-4214-8b23-2abfcb92ad4b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:52.788547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7014ed-2613-4214-8b23-2abfcb92ad4b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:52.788812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7014ed-2613-4214-8b23-2abfcb92ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:52.808772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bb7014ed-2613-4214-8b23-2abfcb92ad4b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:52.809998 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bb7014ed-2613-4214-8b23-2abfcb92ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:52.871060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1195/2383] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:52.879089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b28a5-ac3d-434a-97a6-d92926acda66 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:52.879380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b28a5-ac3d-434a-97a6-d92926acda66 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:52.879655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b28a5-ac3d-434a-97a6-d92926acda66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:52.899556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-dc7b28a5-ac3d-434a-97a6-d92926acda66 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:52.900763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-dc7b28a5-ac3d-434a-97a6-d92926acda66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:52.909467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1189/2384] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:52.913650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7014ed-2613-4214-8b23-2abfcb92ad4b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:52.923841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7014ed-2613-4214-8b23-2abfcb92ad4b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:52.928342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac1346-68a9-4fa5-8d42-3d995f7722b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:52.928921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac1346-68a9-4fa5-8d42-3d995f7722b9 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:52.929193 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac1346-68a9-4fa5-8d42-3d995f7722b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:52.929486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac1346-68a9-4fa5-8d42-3d995f7722b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:52.930117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac1346-68a9-4fa5-8d42-3d995f7722b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:07:52.930414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac1346-68a9-4fa5-8d42-3d995f7722b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:52.931982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac1346-68a9-4fa5-8d42-3d995f7722b9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:52.943321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1196/2385] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:07:52.947599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b28a5-ac3d-434a-97a6-d92926acda66 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:52.956693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b28a5-ac3d-434a-97a6-d92926acda66 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:52.961461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b89d49-933a-40c4-9306-cd0cfc156d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:52.962065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b89d49-933a-40c4-9306-cd0cfc156d8b admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:52.962338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b89d49-933a-40c4-9306-cd0cfc156d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:52.962604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b89d49-933a-40c4-9306-cd0cfc156d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:52.963219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b89d49-933a-40c4-9306-cd0cfc156d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:52.965399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b89d49-933a-40c4-9306-cd0cfc156d8b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:53.065424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1190/2386] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:07:52 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:07:53.069479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac1346-68a9-4fa5-8d42-3d995f7722b9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:53.079851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac1346-68a9-4fa5-8d42-3d995f7722b9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:53.133676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236dfcd-f710-40d8-88e5-efbe8be48829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:53.134273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236dfcd-f710-40d8-88e5-efbe8be48829 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:53.134531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236dfcd-f710-40d8-88e5-efbe8be48829 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:53.134797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236dfcd-f710-40d8-88e5-efbe8be48829 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:53.135404 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236dfcd-f710-40d8-88e5-efbe8be48829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:53.137328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236dfcd-f710-40d8-88e5-efbe8be48829 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:53.211420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1197/2387] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:07:53 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:07:53.216076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b89d49-933a-40c4-9306-cd0cfc156d8b admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:53.227920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b89d49-933a-40c4-9306-cd0cfc156d8b admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:53.232718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071390f-4a8d-4eaf-b0b3-7a6a58f92daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:53.233347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071390f-4a8d-4eaf-b0b3-7a6a58f92daf admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:53.233633 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071390f-4a8d-4eaf-b0b3-7a6a58f92daf admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:53.233902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071390f-4a8d-4eaf-b0b3-7a6a58f92daf admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:53.234592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071390f-4a8d-4eaf-b0b3-7a6a58f92daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:53.236179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071390f-4a8d-4eaf-b0b3-7a6a58f92daf admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:53.246501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1191/2388] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:07:53.250550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236dfcd-f710-40d8-88e5-efbe8be48829 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:53.260392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236dfcd-f710-40d8-88e5-efbe8be48829 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:53.265524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2aa371-a859-4aad-930e-80283f7c8122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:53.266106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aa371-a859-4aad-930e-80283f7c8122 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:53.266379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aa371-a859-4aad-930e-80283f7c8122 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:53.266647 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aa371-a859-4aad-930e-80283f7c8122 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:53.267273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2aa371-a859-4aad-930e-80283f7c8122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:53.268841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2aa371-a859-4aad-930e-80283f7c8122 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:53.270042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:53.280304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1198/2389] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:07:53.284425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071390f-4a8d-4eaf-b0b3-7a6a58f92daf admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:53.294110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071390f-4a8d-4eaf-b0b3-7a6a58f92daf admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:53.298981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3d21f-1bba-4e91-a6d0-79a58402a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:53.299601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3d21f-1bba-4e91-a6d0-79a58402a973 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:53.299870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3d21f-1bba-4e91-a6d0-79a58402a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:53.300134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3d21f-1bba-4e91-a6d0-79a58402a973 admin admin] PATH_INFO: `/v3/projects/7637839d1b8f4e83ae6b52d6d205c17c/users/6fd0fb9218e049cd8680f548fc67f326/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:53.314486 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3d21f-1bba-4e91-a6d0-79a58402a973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7637839d1b8f4e83ae6b52d6d205c17c, user_id=6fd0fb9218e049cd8680f548fc67f326, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:53.317196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3d21f-1bba-4e91-a6d0-79a58402a973 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:53.423725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1192/2390] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:07:53 2022] PUT /identity/v3/projects/7637839d1b8f4e83ae6b52d6d205c17c/users/6fd0fb9218e049cd8680f548fc67f326/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:53.428687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daebe6c-9339-40d6-ab75-0cfc96f1c474 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:53.428969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daebe6c-9339-40d6-ab75-0cfc96f1c474 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:53.429263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daebe6c-9339-40d6-ab75-0cfc96f1c474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:53.448096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5daebe6c-9339-40d6-ab75-0cfc96f1c474 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:53.449277 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5daebe6c-9339-40d6-ab75-0cfc96f1c474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:53.514559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1199/2391] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:53.524617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3d21f-1bba-4e91-a6d0-79a58402a973 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:53.527207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-17d3d21f-1bba-4e91-a6d0-79a58402a973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:53.592039 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3d21f-1bba-4e91-a6d0-79a58402a973 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:53.592039 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9b30e-8595-4365-87a2-303db2ec965e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:53.592039 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9b30e-8595-4365-87a2-303db2ec965e service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:53.592039 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9b30e-8595-4365-87a2-303db2ec965e service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:53.593031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9b30e-8595-4365-87a2-303db2ec965e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:53.600088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9b30e-8595-4365-87a2-303db2ec965e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:53.601527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9b30e-8595-4365-87a2-303db2ec965e service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:53.610754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1193/2392] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:54.883214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125f38a-5845-440d-9a2f-9436219b0e54 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:54.883735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125f38a-5845-440d-9a2f-9436219b0e54 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:54.883735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125f38a-5845-440d-9a2f-9436219b0e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:54.912400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4125f38a-5845-440d-9a2f-9436219b0e54 None None] MFA Rules not processed for user `6fd0fb9218e049cd8680f548fc67f326`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:54.913859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4125f38a-5845-440d-9a2f-9436219b0e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:54.984369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1200/2393] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:54.989571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9b30e-8595-4365-87a2-303db2ec965e service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:55.000378 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9b30e-8595-4365-87a2-303db2ec965e service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:55.005089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c395f5c-0e10-4970-ba9c-4588d134980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:55.005723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c395f5c-0e10-4970-ba9c-4588d134980d admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:55.005998 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c395f5c-0e10-4970-ba9c-4588d134980d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:55.006263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c395f5c-0e10-4970-ba9c-4588d134980d admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:55.006891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c395f5c-0e10-4970-ba9c-4588d134980d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:55.008805 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c395f5c-0e10-4970-ba9c-4588d134980d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:55.114450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1194/2394] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:07:54 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:07:55.115613 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125f38a-5845-440d-9a2f-9436219b0e54 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:55.126792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125f38a-5845-440d-9a2f-9436219b0e54 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:55.181793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bb009-264e-47c9-acb1-ed4bc77a61b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:55.182388 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb009-264e-47c9-acb1-ed4bc77a61b9 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:55.182667 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb009-264e-47c9-acb1-ed4bc77a61b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:55.182947 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb009-264e-47c9-acb1-ed4bc77a61b9 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:55.183567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bb009-264e-47c9-acb1-ed4bc77a61b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:55.185502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bb009-264e-47c9-acb1-ed4bc77a61b9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:55.275952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1201/2395] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:07:55 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:07:55.279827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c395f5c-0e10-4970-ba9c-4588d134980d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:55.290239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c395f5c-0e10-4970-ba9c-4588d134980d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:55.294933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d016a0-638f-43ab-bd28-c920f8df2f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:55.296025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d016a0-638f-43ab-bd28-c920f8df2f43 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:55.296299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d016a0-638f-43ab-bd28-c920f8df2f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:55.296561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d016a0-638f-43ab-bd28-c920f8df2f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:55.297192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d016a0-638f-43ab-bd28-c920f8df2f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:55.298836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d016a0-638f-43ab-bd28-c920f8df2f43 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:55.309383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1195/2396] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:07:55.313936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bb009-264e-47c9-acb1-ed4bc77a61b9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:55.323703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bb009-264e-47c9-acb1-ed4bc77a61b9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:55.328414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b314478-2f71-4f90-a64e-3105b614438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:55.329048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314478-2f71-4f90-a64e-3105b614438d admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:55.329359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314478-2f71-4f90-a64e-3105b614438d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:55.329635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314478-2f71-4f90-a64e-3105b614438d admin admin] PATH_INFO: `/v3/projects/f22e779f824943608398472e389e19c0/users/fe96ded18c5d4b868f5afe0326214cc4/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:55.341632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:55.344556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b314478-2f71-4f90-a64e-3105b614438d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22e779f824943608398472e389e19c0, user_id=fe96ded18c5d4b868f5afe0326214cc4, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:55.347209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b314478-2f71-4f90-a64e-3105b614438d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:55.418010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1202/2397] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:07:55 2022] PUT /identity/v3/projects/f22e779f824943608398472e389e19c0/users/fe96ded18c5d4b868f5afe0326214cc4/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:55.422544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d016a0-638f-43ab-bd28-c920f8df2f43 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:55.432304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d016a0-638f-43ab-bd28-c920f8df2f43 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:55.440704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:55.493168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c60126-cee2-4ff8-b3e7-0b978efaaced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:55.494254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c60126-cee2-4ff8-b3e7-0b978efaaced admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:55.494587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c60126-cee2-4ff8-b3e7-0b978efaaced admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:55.494858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c60126-cee2-4ff8-b3e7-0b978efaaced admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:55.495491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c60126-cee2-4ff8-b3e7-0b978efaaced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:55.497902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c60126-cee2-4ff8-b3e7-0b978efaaced admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:55.509024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1196/2398] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:07:55.513177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b314478-2f71-4f90-a64e-3105b614438d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:55.523504 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b314478-2f71-4f90-a64e-3105b614438d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:55.528125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8ef67-050c-4319-8305-fece6b261ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:55.528999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8ef67-050c-4319-8305-fece6b261ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:55.529285 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8ef67-050c-4319-8305-fece6b261ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:55.529584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8ef67-050c-4319-8305-fece6b261ac5 admin admin] PATH_INFO: `/v3/projects/f22e779f824943608398472e389e19c0/users/fe96ded18c5d4b868f5afe0326214cc4/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:55.531472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8ef67-050c-4319-8305-fece6b261ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22e779f824943608398472e389e19c0, user_id=fe96ded18c5d4b868f5afe0326214cc4, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:55.534168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8ef67-050c-4319-8305-fece6b261ac5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:55.546033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1203/2399] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:07:55 2022] PUT /identity/v3/projects/f22e779f824943608398472e389e19c0/users/fe96ded18c5d4b868f5afe0326214cc4/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:07:56.731575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd43d1-01ed-4b54-92f6-cf350b17e981 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:56.732099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd43d1-01ed-4b54-92f6-cf350b17e981 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:56.732099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd43d1-01ed-4b54-92f6-cf350b17e981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:56.760140 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-2dbd43d1-01ed-4b54-92f6-cf350b17e981 None None] MFA Rules not processed for user `fe96ded18c5d4b868f5afe0326214cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:56.761384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2dbd43d1-01ed-4b54-92f6-cf350b17e981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:56.835880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1197/2400] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:56.847500 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987b7db-125d-4ffc-bb5b-11cac86cff03 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:56.850411 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987b7db-125d-4ffc-bb5b-11cac86cff03 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:56.850411 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987b7db-125d-4ffc-bb5b-11cac86cff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:56.867526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8987b7db-125d-4ffc-bb5b-11cac86cff03 None None] MFA Rules not processed for user `6fd0fb9218e049cd8680f548fc67f326`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:07:56.868692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8987b7db-125d-4ffc-bb5b-11cac86cff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:56.923384 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1204/2401] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:07:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:07:56.937014 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd43d1-01ed-4b54-92f6-cf350b17e981 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:07:56.938494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2dbd43d1-01ed-4b54-92f6-cf350b17e981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:07:57.010385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd43d1-01ed-4b54-92f6-cf350b17e981 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:07:57.015836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb5b6c-4402-4411-ae9b-eae69bc8d3b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:07:57.016429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb5b6c-4402-4411-ae9b-eae69bc8d3b4 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:07:57.016701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb5b6c-4402-4411-ae9b-eae69bc8d3b4 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:07:57.016968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb5b6c-4402-4411-ae9b-eae69bc8d3b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:07:57.024418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb5b6c-4402-4411-ae9b-eae69bc8d3b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:07:57.026009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb5b6c-4402-4411-ae9b-eae69bc8d3b4 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:07:57.034638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1198/2402] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:07:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:08:06.916342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=33,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:07.031034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:15.123039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987b7db-125d-4ffc-bb5b-11cac86cff03 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:15.125055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8987b7db-125d-4ffc-bb5b-11cac86cff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:15.185497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987b7db-125d-4ffc-bb5b-11cac86cff03 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:15.189712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bbbd8-a739-4a92-80ad-6a42dbaddb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:15.190305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bbbd8-a739-4a92-80ad-6a42dbaddb66 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:15.190586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bbbd8-a739-4a92-80ad-6a42dbaddb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:15.190856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bbbd8-a739-4a92-80ad-6a42dbaddb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:15.199540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bbbd8-a739-4a92-80ad-6a42dbaddb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:15.200965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bbbd8-a739-4a92-80ad-6a42dbaddb66 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:15.210179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1205/2403] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:08:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:08:25.206035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=26 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:29.255174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d55bd-db48-4b79-bee1-0e8ef2e8e9f4 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:29.255691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d55bd-db48-4b79-bee1-0e8ef2e8e9f4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:29.255886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d55bd-db48-4b79-bee1-0e8ef2e8e9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:29.294646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-6c2d55bd-db48-4b79-bee1-0e8ef2e8e9f4 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:08:29.295870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6c2d55bd-db48-4b79-bee1-0e8ef2e8e9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:29.375136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1199/2404] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:08:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:08:29.548906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bbbd8-a739-4a92-80ad-6a42dbaddb66 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:29.552668 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f72bbbd8-a739-4a92-80ad-6a42dbaddb66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:29.655901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bbbd8-a739-4a92-80ad-6a42dbaddb66 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:29.660983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6bd8c-4b77-4c29-b194-8c791e6d618c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:29.661655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6bd8c-4b77-4c29-b194-8c791e6d618c service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:29.664866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6bd8c-4b77-4c29-b194-8c791e6d618c service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:29.664866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6bd8c-4b77-4c29-b194-8c791e6d618c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:29.670046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6bd8c-4b77-4c29-b194-8c791e6d618c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:29.671616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6bd8c-4b77-4c29-b194-8c791e6d618c service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:29.679417 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1206/2405] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:08:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:31.633352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d55bd-db48-4b79-bee1-0e8ef2e8e9f4 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:31.634976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6c2d55bd-db48-4b79-bee1-0e8ef2e8e9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:31.744329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d55bd-db48-4b79-bee1-0e8ef2e8e9f4 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:31.751013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285a96b-4fc2-453b-b4cf-2c60a1f63e26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:31.751617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285a96b-4fc2-453b-b4cf-2c60a1f63e26 service placement] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:31.751892 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285a96b-4fc2-453b-b4cf-2c60a1f63e26 service placement] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:31.752160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285a96b-4fc2-453b-b4cf-2c60a1f63e26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:31.753894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b285a96b-4fc2-453b-b4cf-2c60a1f63e26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:31.775533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285a96b-4fc2-453b-b4cf-2c60a1f63e26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:31.778090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285a96b-4fc2-453b-b4cf-2c60a1f63e26 service placement] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:31.792418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1200/2406] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:08:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:08:39.045258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d8744-f84a-461c-9a55-6b9f7129c7e8 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:39.046221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d8744-f84a-461c-9a55-6b9f7129c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:39.046747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d8744-f84a-461c-9a55-6b9f7129c7e8 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:39.048354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1207/2407] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:08:39.061356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f2874-c7c0-4942-9f74-ae3c755386ce None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:39.061917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f2874-c7c0-4942-9f74-ae3c755386ce None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:39.061917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f2874-c7c0-4942-9f74-ae3c755386ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:39.134297 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-5c3f2874-c7c0-4942-9f74-ae3c755386ce None None] MFA Rules not processed for user `6d9439b0577446f1ae9ff61a23df4143`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:08:39.135564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5c3f2874-c7c0-4942-9f74-ae3c755386ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:39.147279 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1201/2408] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:08:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:08:39.162319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d8744-f84a-461c-9a55-6b9f7129c7e8 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:39.164253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f42d8744-f84a-461c-9a55-6b9f7129c7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:39.182860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d8744-f84a-461c-9a55-6b9f7129c7e8 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:39.190329 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1589f-b52a-4140-89ba-b15eb46cfbb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:39.191141 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1589f-b52a-4140-89ba-b15eb46cfbb7 service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:39.191559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1589f-b52a-4140-89ba-b15eb46cfbb7 service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:39.191975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1589f-b52a-4140-89ba-b15eb46cfbb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:39.203653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1589f-b52a-4140-89ba-b15eb46cfbb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:39.205513 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1589f-b52a-4140-89ba-b15eb46cfbb7 service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:39.217573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1208/2409] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:08:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:08:40.061970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f2874-c7c0-4942-9f74-ae3c755386ce None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:40.066415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:40.177110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f2874-c7c0-4942-9f74-ae3c755386ce None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:40.182452 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:40.183177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:40.185445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:40.185445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] PATH_INFO: `/v3/users/6fd0fb9218e049cd8680f548fc67f326` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:40.187122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd0fb9218e049cd8680f548fc67f326)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:40.190112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:40.399349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd0fb9218e049cd8680f548fc67f326'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:40.409926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd0fb9218e049cd8680f548fc67f326'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:40.425847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd0fb9218e049cd8680f548fc67f326'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:40.426583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd0fb9218e049cd8680f548fc67f326'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:40.438237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd0fb9218e049cd8680f548fc67f326'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:40.548151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1202/2410] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:08:40 2022] DELETE /identity/v3/users/6fd0fb9218e049cd8680f548fc67f326 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:08:40.869349 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1589f-b52a-4140-89ba-b15eb46cfbb7 service placement] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:40.888301 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1589f-b52a-4140-89ba-b15eb46cfbb7 service placement] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:41.005624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:41.006380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:41.006549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:41.006808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] PATH_INFO: `/v3/projects/7637839d1b8f4e83ae6b52d6d205c17c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:41.013913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7637839d1b8f4e83ae6b52d6d205c17c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:41.013913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:41.146570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:41.148092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7637839d1b8f4e83ae6b52d6d205c17c', 'request_id': 'req-b8886ddd-4e42-4524-a98e-229952964659'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:41.156671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7637839d1b8f4e83ae6b52d6d205c17c', 'request_id': 'req-b8886ddd-4e42-4524-a98e-229952964659'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:41.282503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7637839d1b8f4e83ae6b52d6d205c17c', 'request_id': 'req-b8886ddd-4e42-4524-a98e-229952964659'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:41.313897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] The token cache is being invalidate because project 7637839d1b8f4e83ae6b52d6d205c17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:08:41.314309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:41.314987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:41.319321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1209/2411] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:40 2022] DELETE /identity/v3/projects/7637839d1b8f4e83ae6b52d6d205c17c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:08:41.322328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:41.323869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:41.338096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648350cf-e705-46f5-b267-22c4cb66d4d8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:41.399416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:41.400050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:41.416919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:41.416919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] PATH_INFO: `/v3/users/fe96ded18c5d4b868f5afe0326214cc4` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:41.416919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe96ded18c5d4b868f5afe0326214cc4)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:41.416919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:41.416919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:41.737875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe96ded18c5d4b868f5afe0326214cc4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:41.744529 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe96ded18c5d4b868f5afe0326214cc4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:41.757233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe96ded18c5d4b868f5afe0326214cc4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:41.757923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe96ded18c5d4b868f5afe0326214cc4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:41.758581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4d7201d-6d87-4cc9-ac27-f02dff44c1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe96ded18c5d4b868f5afe0326214cc4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:41.845869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1203/2412] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:08:41 2022] DELETE /identity/v3/users/fe96ded18c5d4b868f5afe0326214cc4 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:08:42.090643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:42.093047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:42.112047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8886ddd-4e42-4524-a98e-229952964659 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:42.202897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:42.203248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:42.203530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:42.203987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] PATH_INFO: `/v3/projects/f22e779f824943608398472e389e19c0` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:42.205203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22e779f824943608398472e389e19c0)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:42.207923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:42.345215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22e779f824943608398472e389e19c0', 'request_id': 'req-b85f2183-104d-4afd-a8c2-a71159457679'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:42.351945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22e779f824943608398472e389e19c0', 'request_id': 'req-b85f2183-104d-4afd-a8c2-a71159457679'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:42.435093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22e779f824943608398472e389e19c0', 'request_id': 'req-b85f2183-104d-4afd-a8c2-a71159457679'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:42.448676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] The token cache is being invalidate because project f22e779f824943608398472e389e19c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:08:42.448962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:42.449611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b85f2183-104d-4afd-a8c2-a71159457679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:08:42.456104 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffa2c4-d854-4123-9e46-86076d565ede None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:42.456693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffa2c4-d854-4123-9e46-86076d565ede None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:42.456693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffa2c4-d854-4123-9e46-86076d565ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:42.457122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1210/2413] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:42 2022] DELETE /identity/v3/projects/f22e779f824943608398472e389e19c0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:08:42.522456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-3fffa2c4-d854-4123-9e46-86076d565ede None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:08:42.523776 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3fffa2c4-d854-4123-9e46-86076d565ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:42.592595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1204/2414] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:08:42.600830 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4a59-cd4c-4fcb-add4-85df1a006e96 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:42.601320 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4a59-cd4c-4fcb-add4-85df1a006e96 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:42.601591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4a59-cd4c-4fcb-add4-85df1a006e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:42.622596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-922c4a59-cd4c-4fcb-add4-85df1a006e96 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:08:42.623730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-922c4a59-cd4c-4fcb-add4-85df1a006e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:42.632165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1211/2415] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:08:42.636534 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffa2c4-d854-4123-9e46-86076d565ede None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:42.647292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffa2c4-d854-4123-9e46-86076d565ede None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:42.652174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5c690-fc66-43a1-9b66-ada7123552ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:42.652965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c690-fc66-43a1-9b66-ada7123552ce admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:42.653359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c690-fc66-43a1-9b66-ada7123552ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:42.653734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c690-fc66-43a1-9b66-ada7123552ce admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:42.655305 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5c690-fc66-43a1-9b66-ada7123552ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:08:42.655715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5c690-fc66-43a1-9b66-ada7123552ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:42.657487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5c690-fc66-43a1-9b66-ada7123552ce admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:42.671859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1205/2416] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:08:42.678144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c4a59-cd4c-4fcb-add4-85df1a006e96 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:42.688012 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c4a59-cd4c-4fcb-add4-85df1a006e96 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:42.693970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54927608-612a-46a8-9f44-d15fbc3e1f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:42.694585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54927608-612a-46a8-9f44-d15fbc3e1f3c admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:42.694862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54927608-612a-46a8-9f44-d15fbc3e1f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:42.695132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54927608-612a-46a8-9f44-d15fbc3e1f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:42.695795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54927608-612a-46a8-9f44-d15fbc3e1f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:42.697728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54927608-612a-46a8-9f44-d15fbc3e1f3c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:42.858964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1212/2417] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:08:42 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:08:42.863188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5c690-fc66-43a1-9b66-ada7123552ce admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:42.873181 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5c690-fc66-43a1-9b66-ada7123552ce admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:42.918621 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:42.930432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6997c71-bd60-426f-bcee-a351f7436073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:42.931145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6997c71-bd60-426f-bcee-a351f7436073 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:42.931423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6997c71-bd60-426f-bcee-a351f7436073 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:42.931690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6997c71-bd60-426f-bcee-a351f7436073 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:42.932310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6997c71-bd60-426f-bcee-a351f7436073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:42.934260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6997c71-bd60-426f-bcee-a351f7436073 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:43.038783 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1206/2418] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:08:42 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:08:43.040080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54927608-612a-46a8-9f44-d15fbc3e1f3c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:43.050349 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54927608-612a-46a8-9f44-d15fbc3e1f3c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:43.054890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e724b-88b0-4977-b35d-09e40fa9bad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:43.055475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e724b-88b0-4977-b35d-09e40fa9bad8 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:43.058428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e724b-88b0-4977-b35d-09e40fa9bad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:43.058428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e724b-88b0-4977-b35d-09e40fa9bad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:43.058428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e724b-88b0-4977-b35d-09e40fa9bad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:43.058428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e724b-88b0-4977-b35d-09e40fa9bad8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:43.068329 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1213/2419] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:08:43.072317 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6997c71-bd60-426f-bcee-a351f7436073 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:43.082988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6997c71-bd60-426f-bcee-a351f7436073 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:43.087626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ef0c9-505c-42c3-9e7e-5f1a1cdf681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:43.088223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef0c9-505c-42c3-9e7e-5f1a1cdf681d admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:43.088500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef0c9-505c-42c3-9e7e-5f1a1cdf681d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:43.088769 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef0c9-505c-42c3-9e7e-5f1a1cdf681d admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:43.089440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ef0c9-505c-42c3-9e7e-5f1a1cdf681d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:43.091001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ef0c9-505c-42c3-9e7e-5f1a1cdf681d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:43.101695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1207/2420] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:08:43.105766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e724b-88b0-4977-b35d-09e40fa9bad8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:43.115699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e724b-88b0-4977-b35d-09e40fa9bad8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:43.120287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8bb2c-85a7-48ef-94de-5efcba2c679a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:43.121010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8bb2c-85a7-48ef-94de-5efcba2c679a admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:43.121313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8bb2c-85a7-48ef-94de-5efcba2c679a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:43.121588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8bb2c-85a7-48ef-94de-5efcba2c679a admin admin] PATH_INFO: `/v3/projects/30fcb69e1459481190344576ef838996/users/e2e1aa9bf09240959d22bdeb0339daa7/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:43.133741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:43.136689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8bb2c-85a7-48ef-94de-5efcba2c679a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fcb69e1459481190344576ef838996, user_id=e2e1aa9bf09240959d22bdeb0339daa7, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:43.140032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8bb2c-85a7-48ef-94de-5efcba2c679a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:43.225093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1214/2421] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:08:43 2022] PUT /identity/v3/projects/30fcb69e1459481190344576ef838996/users/e2e1aa9bf09240959d22bdeb0339daa7/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:08:43.236243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cda0e-bcf7-438d-a84d-5f83bfd45a08 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:43.236531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cda0e-bcf7-438d-a84d-5f83bfd45a08 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:43.236806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cda0e-bcf7-438d-a84d-5f83bfd45a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:43.265591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ae3cda0e-bcf7-438d-a84d-5f83bfd45a08 None None] MFA Rules not processed for user `e2e1aa9bf09240959d22bdeb0339daa7`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:08:43.266809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ae3cda0e-bcf7-438d-a84d-5f83bfd45a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:43.332157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1208/2422] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:08:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:08:43.343253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8bb2c-85a7-48ef-94de-5efcba2c679a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:43.344940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9cf8bb2c-85a7-48ef-94de-5efcba2c679a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:43.406945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8bb2c-85a7-48ef-94de-5efcba2c679a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:43.410614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70e9fa-20d2-4ddd-8af1-d580909d005a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e86be85010d4851a1ce3381832af230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:43.411216 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70e9fa-20d2-4ddd-8af1-d580909d005a service glance] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:43.411491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70e9fa-20d2-4ddd-8af1-d580909d005a service glance] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:43.411762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70e9fa-20d2-4ddd-8af1-d580909d005a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:43.420584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70e9fa-20d2-4ddd-8af1-d580909d005a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:43.422061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70e9fa-20d2-4ddd-8af1-d580909d005a service glance] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:43.430616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1215/2423] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:08:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:08:50.343764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267c976-ba8f-4a74-afe9-51da3cc6f9f5 None None] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:50.344250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267c976-ba8f-4a74-afe9-51da3cc6f9f5 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:50.344390 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267c976-ba8f-4a74-afe9-51da3cc6f9f5 None None] PATH_INFO: `/` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:50.345685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1209/2424] 10.222.0.77 () {54 vars in 921 bytes} [Wed Aug 10 23:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 23:08:50.350600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae96f7-6684-4a88-bef0-af909ce6e5ff None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:50.351144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae96f7-6684-4a88-bef0-af909ce6e5ff None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:50.351144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae96f7-6684-4a88-bef0-af909ce6e5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:50.383476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ddae96f7-6684-4a88-bef0-af909ce6e5ff None None] MFA Rules not processed for user `34568b830fc641edab39324047368546`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:08:50.384684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ddae96f7-6684-4a88-bef0-af909ce6e5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:50.467716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1216/2425] 10.222.0.77 () {58 vars in 1018 bytes} [Wed Aug 10 23:08:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:08:50.479445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267c976-ba8f-4a74-afe9-51da3cc6f9f5 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:50.491094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267c976-ba8f-4a74-afe9-51da3cc6f9f5 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:50.494837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91df8d3-45aa-4357-bbdc-a131a92213e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e86be85010d4851a1ce3381832af230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:50.495209 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91df8d3-45aa-4357-bbdc-a131a92213e0 service glance] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:50.495484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91df8d3-45aa-4357-bbdc-a131a92213e0 service glance] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:50.495755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91df8d3-45aa-4357-bbdc-a131a92213e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:50.506608 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91df8d3-45aa-4357-bbdc-a131a92213e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:50.508029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91df8d3-45aa-4357-bbdc-a131a92213e0 service glance] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:50.519528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1210/2426] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:08:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:08:53.211689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30040d-9536-4020-8d49-b5f00347e81e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:53.212153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30040d-9536-4020-8d49-b5f00347e81e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:53.212245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30040d-9536-4020-8d49-b5f00347e81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:53.233526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5a30040d-9536-4020-8d49-b5f00347e81e None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:08:53.234808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5a30040d-9536-4020-8d49-b5f00347e81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:53.290224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1217/2427] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:08:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:08:53.301963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91df8d3-45aa-4357-bbdc-a131a92213e0 service glance] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:08:53.303353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e91df8d3-45aa-4357-bbdc-a131a92213e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:08:53.371359 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91df8d3-45aa-4357-bbdc-a131a92213e0 service glance] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:08:53.376660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2735-3197-4e01-be72-5842ea2cbba5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:08:53.377277 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2735-3197-4e01-be72-5842ea2cbba5 service swift] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:08:53.377585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2735-3197-4e01-be72-5842ea2cbba5 service swift] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:08:53.377855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2735-3197-4e01-be72-5842ea2cbba5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:08:53.386184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf2735-3197-4e01-be72-5842ea2cbba5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:08:53.387755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf2735-3197-4e01-be72-5842ea2cbba5 service swift] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:08:53.396286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1211/2428] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:08:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:03.283766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:03.392929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:05.871212 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30040d-9536-4020-8d49-b5f00347e81e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:05.933592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30040d-9536-4020-8d49-b5f00347e81e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:05.938077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:05.938694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:05.938973 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:05.939246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] PATH_INFO: `/v3/users/e2e1aa9bf09240959d22bdeb0339daa7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:05.940359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e1aa9bf09240959d22bdeb0339daa7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:05.942318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:06.127114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e1aa9bf09240959d22bdeb0339daa7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:06.139208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e1aa9bf09240959d22bdeb0339daa7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:06.141471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e1aa9bf09240959d22bdeb0339daa7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:06.141471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e1aa9bf09240959d22bdeb0339daa7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:06.211269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e1aa9bf09240959d22bdeb0339daa7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:06.224062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1218/2429] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:09:05 2022] DELETE /identity/v3/users/e2e1aa9bf09240959d22bdeb0339daa7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:06.228828 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c79af-6040-4842-bcc9-2f047c2419a9 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:06.229352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c79af-6040-4842-bcc9-2f047c2419a9 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:06.229466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c79af-6040-4842-bcc9-2f047c2419a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:06.248208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-281c79af-6040-4842-bcc9-2f047c2419a9 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:06.249509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-281c79af-6040-4842-bcc9-2f047c2419a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:06.305964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1212/2430] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:09:06.315606 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:06.317024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:06.392463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498dc40-cf39-4e2a-ade4-c5b99cd42d6d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:06.395955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b1d91-9c00-4200-8eba-60b490c033cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:06.396538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1d91-9c00-4200-8eba-60b490c033cb service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:06.396811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1d91-9c00-4200-8eba-60b490c033cb service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:06.397078 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1d91-9c00-4200-8eba-60b490c033cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:06.405746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b1d91-9c00-4200-8eba-60b490c033cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:06.407152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b1d91-9c00-4200-8eba-60b490c033cb service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:06.416643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1219/2431] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:09:06.808404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c79af-6040-4842-bcc9-2f047c2419a9 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:06.809844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-281c79af-6040-4842-bcc9-2f047c2419a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:06.821907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c79af-6040-4842-bcc9-2f047c2419a9 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:06.826389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:06.827054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:06.827441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:06.827646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] PATH_INFO: `/v3/projects/30fcb69e1459481190344576ef838996` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:06.828792 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30fcb69e1459481190344576ef838996)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:06.830714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:06.927226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30fcb69e1459481190344576ef838996', 'request_id': 'req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:06.934525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30fcb69e1459481190344576ef838996', 'request_id': 'req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:06.996539 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30fcb69e1459481190344576ef838996', 'request_id': 'req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:07.007819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] The token cache is being invalidate because project 30fcb69e1459481190344576ef838996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:09:07.013089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:07.013089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c7d6e5-b72b-4d77-b799-c071a6c94ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:07.013089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1213/2432] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:09:06 2022] DELETE /identity/v3/projects/30fcb69e1459481190344576ef838996 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:07.015368 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e5455-1b2a-4e78-8d88-65afd73a1714 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:07.015839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e5455-1b2a-4e78-8d88-65afd73a1714 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:07.015962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e5455-1b2a-4e78-8d88-65afd73a1714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:07.023890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:07.036304 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5d5e5455-1b2a-4e78-8d88-65afd73a1714 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:07.038132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5d5e5455-1b2a-4e78-8d88-65afd73a1714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:07.098120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1220/2433] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:07.106623 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497b36-fc0c-4fac-99a3-c1fa606666ca None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:07.106904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497b36-fc0c-4fac-99a3-c1fa606666ca None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:07.107174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497b36-fc0c-4fac-99a3-c1fa606666ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:07.251670 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-03497b36-fc0c-4fac-99a3-c1fa606666ca None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:07.253032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-03497b36-fc0c-4fac-99a3-c1fa606666ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:07.260757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1214/2434] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:07.265112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e5455-1b2a-4e78-8d88-65afd73a1714 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:07.275543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e5455-1b2a-4e78-8d88-65afd73a1714 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:07.280085 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2761ee-d642-4ee9-9bc7-3ab4b4fdc7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:07.280671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2761ee-d642-4ee9-9bc7-3ab4b4fdc7ce admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:07.280963 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2761ee-d642-4ee9-9bc7-3ab4b4fdc7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:07.281380 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2761ee-d642-4ee9-9bc7-3ab4b4fdc7ce admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:07.282014 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2761ee-d642-4ee9-9bc7-3ab4b4fdc7ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:09:07.282310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2761ee-d642-4ee9-9bc7-3ab4b4fdc7ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:07.283910 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2761ee-d642-4ee9-9bc7-3ab4b4fdc7ce admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:07.295787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1221/2435] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:09:07.305127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497b36-fc0c-4fac-99a3-c1fa606666ca None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:07.315354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497b36-fc0c-4fac-99a3-c1fa606666ca None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:07.320082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732919c9-e5e8-4971-bc1d-11255161c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:07.320665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732919c9-e5e8-4971-bc1d-11255161c299 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:07.320932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732919c9-e5e8-4971-bc1d-11255161c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:07.321194 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732919c9-e5e8-4971-bc1d-11255161c299 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:07.321837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732919c9-e5e8-4971-bc1d-11255161c299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:07.323796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732919c9-e5e8-4971-bc1d-11255161c299 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:07.415492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1215/2436] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:09:07 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:09:07.420066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2761ee-d642-4ee9-9bc7-3ab4b4fdc7ce admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:07.429887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2761ee-d642-4ee9-9bc7-3ab4b4fdc7ce admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:07.485427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0d040-b03d-415a-9b91-a6823063e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:07.486024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0d040-b03d-415a-9b91-a6823063e184 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:07.486295 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0d040-b03d-415a-9b91-a6823063e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:07.486562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0d040-b03d-415a-9b91-a6823063e184 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:07.487198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0d040-b03d-415a-9b91-a6823063e184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:07.489087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0d040-b03d-415a-9b91-a6823063e184 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:07.572175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1222/2437] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:09:07 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:09:07.576333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732919c9-e5e8-4971-bc1d-11255161c299 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:07.587990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732919c9-e5e8-4971-bc1d-11255161c299 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:07.592416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6a183-fdec-4ecd-9b27-354e70d76d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:07.593275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a183-fdec-4ecd-9b27-354e70d76d08 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:07.593562 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a183-fdec-4ecd-9b27-354e70d76d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:07.593830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a183-fdec-4ecd-9b27-354e70d76d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:07.594460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6a183-fdec-4ecd-9b27-354e70d76d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:07.596023 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6a183-fdec-4ecd-9b27-354e70d76d08 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:07.605725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1216/2438] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:07.609826 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0d040-b03d-415a-9b91-a6823063e184 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:07.619874 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0d040-b03d-415a-9b91-a6823063e184 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:07.624505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbf869-6cdc-48b9-876a-842bf0ce73a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:07.625090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf869-6cdc-48b9-876a-842bf0ce73a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:07.625410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf869-6cdc-48b9-876a-842bf0ce73a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:07.625681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbf869-6cdc-48b9-876a-842bf0ce73a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:07.626336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbf869-6cdc-48b9-876a-842bf0ce73a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:07.627920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbf869-6cdc-48b9-876a-842bf0ce73a9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:07.638846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1223/2439] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:07.648464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6a183-fdec-4ecd-9b27-354e70d76d08 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:07.658307 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6a183-fdec-4ecd-9b27-354e70d76d08 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:07.662846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708a324-a5b0-42d1-8e93-90e83a829490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:07.663476 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708a324-a5b0-42d1-8e93-90e83a829490 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:07.663746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708a324-a5b0-42d1-8e93-90e83a829490 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:07.664013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708a324-a5b0-42d1-8e93-90e83a829490 admin admin] PATH_INFO: `/v3/projects/02f89737da2e442b837e0c16d3e5cba7/users/b8e951fc901f4cc5b2900e2b9d969637/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:07.678008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708a324-a5b0-42d1-8e93-90e83a829490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f89737da2e442b837e0c16d3e5cba7, user_id=b8e951fc901f4cc5b2900e2b9d969637, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:07.680667 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708a324-a5b0-42d1-8e93-90e83a829490 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:07.790611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1217/2440] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:09:07 2022] PUT /identity/v3/projects/02f89737da2e442b837e0c16d3e5cba7/users/b8e951fc901f4cc5b2900e2b9d969637/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:07.800742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495f906-0726-461f-bc18-1a61f2d41c0a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:07.800965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495f906-0726-461f-bc18-1a61f2d41c0a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:07.801309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495f906-0726-461f-bc18-1a61f2d41c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:07.829040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1495f906-0726-461f-bc18-1a61f2d41c0a None None] MFA Rules not processed for user `b8e951fc901f4cc5b2900e2b9d969637`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:07.830261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1495f906-0726-461f-bc18-1a61f2d41c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:07.886803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:07.892069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1224/2441] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:07.896572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708a324-a5b0-42d1-8e93-90e83a829490 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:07.916893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:07.956885 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708a324-a5b0-42d1-8e93-90e83a829490 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:07.961495 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de54b7-82dc-44a8-888c-af32595f0eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:07.962085 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de54b7-82dc-44a8-888c-af32595f0eca admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:07.962355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de54b7-82dc-44a8-888c-af32595f0eca admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:07.962620 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de54b7-82dc-44a8-888c-af32595f0eca admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:07.963235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de54b7-82dc-44a8-888c-af32595f0eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:07.965135 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de54b7-82dc-44a8-888c-af32595f0eca admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:08.055071 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1218/2442] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:09:07 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:09:08.059148 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495f906-0726-461f-bc18-1a61f2d41c0a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:08.070465 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495f906-0726-461f-bc18-1a61f2d41c0a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:08.127376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049e914-aa96-44c1-ad6c-6f2cbe586cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:08.127986 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049e914-aa96-44c1-ad6c-6f2cbe586cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:08.128264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049e914-aa96-44c1-ad6c-6f2cbe586cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:08.128538 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049e914-aa96-44c1-ad6c-6f2cbe586cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:08.129161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049e914-aa96-44c1-ad6c-6f2cbe586cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:08.131740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049e914-aa96-44c1-ad6c-6f2cbe586cd7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:08.243548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1225/2443] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:09:08 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:09:08.252796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de54b7-82dc-44a8-888c-af32595f0eca admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:08.262832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de54b7-82dc-44a8-888c-af32595f0eca admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:08.267286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadcb5a-329d-4b8c-827c-9a63c7ce2fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:08.267870 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadcb5a-329d-4b8c-827c-9a63c7ce2fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:08.268147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadcb5a-329d-4b8c-827c-9a63c7ce2fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:08.268414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadcb5a-329d-4b8c-827c-9a63c7ce2fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:08.269042 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadcb5a-329d-4b8c-827c-9a63c7ce2fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:08.270657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadcb5a-329d-4b8c-827c-9a63c7ce2fa7 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:08.280236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1219/2444] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:08.283856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049e914-aa96-44c1-ad6c-6f2cbe586cd7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:08.294173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049e914-aa96-44c1-ad6c-6f2cbe586cd7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:08.298683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dc053-34d0-4a06-9ef6-f459966f17b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:08.299299 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc053-34d0-4a06-9ef6-f459966f17b1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:08.299571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc053-34d0-4a06-9ef6-f459966f17b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:08.299835 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc053-34d0-4a06-9ef6-f459966f17b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:08.300461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dc053-34d0-4a06-9ef6-f459966f17b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:08.302068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dc053-34d0-4a06-9ef6-f459966f17b1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:08.312282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1226/2445] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:08.316089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadcb5a-329d-4b8c-827c-9a63c7ce2fa7 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:08.325745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadcb5a-329d-4b8c-827c-9a63c7ce2fa7 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:08.330170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39568c6-ca9e-4f85-b1a0-eed1f8a27fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:08.330791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39568c6-ca9e-4f85-b1a0-eed1f8a27fde admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:08.331063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39568c6-ca9e-4f85-b1a0-eed1f8a27fde admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:08.331331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39568c6-ca9e-4f85-b1a0-eed1f8a27fde admin admin] PATH_INFO: `/v3/projects/2155dd0bd23d41f59c647ee75453cbe5/users/7234c79b3c4f454c9584b59815d22da3/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:08.345521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39568c6-ca9e-4f85-b1a0-eed1f8a27fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=2155dd0bd23d41f59c647ee75453cbe5, user_id=7234c79b3c4f454c9584b59815d22da3, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:08.348118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39568c6-ca9e-4f85-b1a0-eed1f8a27fde admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:08.419992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1220/2446] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:09:08 2022] PUT /identity/v3/projects/2155dd0bd23d41f59c647ee75453cbe5/users/7234c79b3c4f454c9584b59815d22da3/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:08.487036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42742-b09b-4883-ad9a-cf1cf0f5c55b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:08.487319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42742-b09b-4883-ad9a-cf1cf0f5c55b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:08.487593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42742-b09b-4883-ad9a-cf1cf0f5c55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:08.523984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-76b42742-b09b-4883-ad9a-cf1cf0f5c55b None None] MFA Rules not processed for user `7234c79b3c4f454c9584b59815d22da3`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:08.525258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-76b42742-b09b-4883-ad9a-cf1cf0f5c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:08.588966 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1227/2447] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:08.593668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39568c6-ca9e-4f85-b1a0-eed1f8a27fde admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:08.653695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39568c6-ca9e-4f85-b1a0-eed1f8a27fde admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:08.658230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b9e3f-8ca8-47a1-8301-6d00f569b517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:08.658820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b9e3f-8ca8-47a1-8301-6d00f569b517 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:08.659096 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b9e3f-8ca8-47a1-8301-6d00f569b517 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:08.659365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b9e3f-8ca8-47a1-8301-6d00f569b517 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:08.659981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b9e3f-8ca8-47a1-8301-6d00f569b517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:08.661882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b9e3f-8ca8-47a1-8301-6d00f569b517 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:08.768907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1221/2448] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:09:08 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:09:08.773595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b42742-b09b-4883-ad9a-cf1cf0f5c55b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:08.784359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b42742-b09b-4883-ad9a-cf1cf0f5c55b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:08.841907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0bbc1-f70a-4087-a37f-6619864ee27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:08.843022 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0bbc1-f70a-4087-a37f-6619864ee27d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:08.843278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0bbc1-f70a-4087-a37f-6619864ee27d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:08.843543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0bbc1-f70a-4087-a37f-6619864ee27d admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:08.844200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0bbc1-f70a-4087-a37f-6619864ee27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:08.846196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0bbc1-f70a-4087-a37f-6619864ee27d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:08.858297 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:08.983463 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1228/2449] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:09:08 2022] POST /identity/v3/users => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:09:08.987385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b9e3f-8ca8-47a1-8301-6d00f569b517 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:08.997266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b9e3f-8ca8-47a1-8301-6d00f569b517 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:09.001661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735248f-22ab-4618-8235-6b0aadbadfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:09.002242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735248f-22ab-4618-8235-6b0aadbadfaa admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:09.002508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735248f-22ab-4618-8235-6b0aadbadfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:09.002768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735248f-22ab-4618-8235-6b0aadbadfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:09.003390 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735248f-22ab-4618-8235-6b0aadbadfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:09.004985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735248f-22ab-4618-8235-6b0aadbadfaa admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:09.015347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1222/2450] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:09.019248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0bbc1-f70a-4087-a37f-6619864ee27d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:09.029713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0bbc1-f70a-4087-a37f-6619864ee27d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:09.034449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac481256-b2e1-4cbb-9d5d-61b1881ac632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:09.035092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac481256-b2e1-4cbb-9d5d-61b1881ac632 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:09.035368 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac481256-b2e1-4cbb-9d5d-61b1881ac632 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:09.035640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac481256-b2e1-4cbb-9d5d-61b1881ac632 admin admin] PATH_INFO: `/v3/projects/77bfb853ddb540eb9b4f9d542d845034/users/b43fbfd54c6d4887a33e300b6bc753d4/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:09.049839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac481256-b2e1-4cbb-9d5d-61b1881ac632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bfb853ddb540eb9b4f9d542d845034, user_id=b43fbfd54c6d4887a33e300b6bc753d4, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:09.052534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac481256-b2e1-4cbb-9d5d-61b1881ac632 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:09.166832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1229/2451] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:09:09 2022] PUT /identity/v3/projects/77bfb853ddb540eb9b4f9d542d845034/users/b43fbfd54c6d4887a33e300b6bc753d4/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:09.174919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735248f-22ab-4618-8235-6b0aadbadfaa admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:09.180610 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735248f-22ab-4618-8235-6b0aadbadfaa admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:09.224026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:09.239884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2d3ff-2e24-4f67-afbb-e5c54fd1b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:09.240525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2d3ff-2e24-4f67-afbb-e5c54fd1b063 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:09.240802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2d3ff-2e24-4f67-afbb-e5c54fd1b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:09.241118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2d3ff-2e24-4f67-afbb-e5c54fd1b063 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:09.241820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2d3ff-2e24-4f67-afbb-e5c54fd1b063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:09.243506 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2d3ff-2e24-4f67-afbb-e5c54fd1b063 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:09.258768 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac481256-b2e1-4cbb-9d5d-61b1881ac632 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:09.259586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1223/2452] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:09.269019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac481256-b2e1-4cbb-9d5d-61b1881ac632 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:09.274452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36805798-3d8f-4a87-a5c4-9973bb816764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:09.275125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36805798-3d8f-4a87-a5c4-9973bb816764 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:09.275400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36805798-3d8f-4a87-a5c4-9973bb816764 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:09.276298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36805798-3d8f-4a87-a5c4-9973bb816764 admin admin] PATH_INFO: `/v3/projects/77bfb853ddb540eb9b4f9d542d845034/users/b43fbfd54c6d4887a33e300b6bc753d4/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:09.277802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36805798-3d8f-4a87-a5c4-9973bb816764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bfb853ddb540eb9b4f9d542d845034, user_id=b43fbfd54c6d4887a33e300b6bc753d4, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:09.280423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36805798-3d8f-4a87-a5c4-9973bb816764 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:09.291656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1230/2453] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:09:09 2022] PUT /identity/v3/projects/77bfb853ddb540eb9b4f9d542d845034/users/b43fbfd54c6d4887a33e300b6bc753d4/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:09:09.302048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539afbb6-109d-4d2e-88d1-37166d8fa3fd None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:09.302334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539afbb6-109d-4d2e-88d1-37166d8fa3fd None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:09.302605 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539afbb6-109d-4d2e-88d1-37166d8fa3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:09.331653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-539afbb6-109d-4d2e-88d1-37166d8fa3fd None None] MFA Rules not processed for user `b43fbfd54c6d4887a33e300b6bc753d4`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:09.332877 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-539afbb6-109d-4d2e-88d1-37166d8fa3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:09.403565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1224/2454] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:09:09.415092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36805798-3d8f-4a87-a5c4-9973bb816764 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:09.416779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-36805798-3d8f-4a87-a5c4-9973bb816764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:09.496698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36805798-3d8f-4a87-a5c4-9973bb816764 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:09.500591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43da8b-f743-476c-8570-f80269ccca7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:09.501192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43da8b-f743-476c-8570-f80269ccca7f service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:09.501504 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43da8b-f743-476c-8570-f80269ccca7f service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:09.501776 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43da8b-f743-476c-8570-f80269ccca7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:09.562448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43da8b-f743-476c-8570-f80269ccca7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:09.563882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43da8b-f743-476c-8570-f80269ccca7f service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:09.573483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1231/2455] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:09:11.549948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539afbb6-109d-4d2e-88d1-37166d8fa3fd None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:11.565146 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539afbb6-109d-4d2e-88d1-37166d8fa3fd None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:11.569488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b74dc-e2f3-425a-922e-86f6d2395602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:11.570155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b74dc-e2f3-425a-922e-86f6d2395602 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:11.570573 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b74dc-e2f3-425a-922e-86f6d2395602 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:11.570904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b74dc-e2f3-425a-922e-86f6d2395602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:11.640186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b74dc-e2f3-425a-922e-86f6d2395602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:11.641991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b74dc-e2f3-425a-922e-86f6d2395602 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:11.653241 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1225/2456] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:09:13.048271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43da8b-f743-476c-8570-f80269ccca7f service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:13.056803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43da8b-f743-476c-8570-f80269ccca7f service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:13.060472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad938ff-c839-4fdc-a72c-c861094e021c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:13.061063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad938ff-c839-4fdc-a72c-c861094e021c service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:13.061372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad938ff-c839-4fdc-a72c-c861094e021c service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:13.061648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad938ff-c839-4fdc-a72c-c861094e021c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:13.071395 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad938ff-c839-4fdc-a72c-c861094e021c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:13.072775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad938ff-c839-4fdc-a72c-c861094e021c service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:13.082370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1232/2457] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:09:15.578045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2a5f7-fc1e-4777-b643-3dd258f8ae8c None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:15.578505 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2a5f7-fc1e-4777-b643-3dd258f8ae8c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:15.578615 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2a5f7-fc1e-4777-b643-3dd258f8ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:15.614120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-81a2a5f7-fc1e-4777-b643-3dd258f8ae8c None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:15.614120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-81a2a5f7-fc1e-4777-b643-3dd258f8ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:15.656419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1226/2458] 10.222.0.77 () {58 vars in 967 bytes} [Wed Aug 10 23:09:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:15.669483 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad938ff-c839-4fdc-a72c-c861094e021c service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:15.670893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7ad938ff-c839-4fdc-a72c-c861094e021c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:15.713545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:15.738806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad938ff-c839-4fdc-a72c-c861094e021c service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:15.744035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b504f-4806-4b13-91f0-2fdf80988eb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:15.744630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b504f-4806-4b13-91f0-2fdf80988eb5 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:15.744915 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b504f-4806-4b13-91f0-2fdf80988eb5 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:15.745177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b504f-4806-4b13-91f0-2fdf80988eb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:15.752963 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b504f-4806-4b13-91f0-2fdf80988eb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:15.754570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b504f-4806-4b13-91f0-2fdf80988eb5 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:15.763003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1233/2459] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:09:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:17.770841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2a5f7-fc1e-4777-b643-3dd258f8ae8c None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:17.780286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:17.843130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2a5f7-fc1e-4777-b643-3dd258f8ae8c None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:17.847867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:17.848491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:17.848765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:17.849032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] PATH_INFO: `/v3/users/b8e951fc901f4cc5b2900e2b9d969637` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:17.850786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e951fc901f4cc5b2900e2b9d969637)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:17.852701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:18.051120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e951fc901f4cc5b2900e2b9d969637'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:18.061772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e951fc901f4cc5b2900e2b9d969637'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:18.076848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e951fc901f4cc5b2900e2b9d969637'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:18.077723 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e951fc901f4cc5b2900e2b9d969637'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:18.078386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e951fc901f4cc5b2900e2b9d969637'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:18.142821 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1227/2460] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:09:17 2022] DELETE /identity/v3/users/b8e951fc901f4cc5b2900e2b9d969637 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:18.147992 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a19de-1cdc-4a3f-9b9d-4e80116584bb None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:18.148493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a19de-1cdc-4a3f-9b9d-4e80116584bb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:18.148603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a19de-1cdc-4a3f-9b9d-4e80116584bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:18.166962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f32a19de-1cdc-4a3f-9b9d-4e80116584bb None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:18.169187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f32a19de-1cdc-4a3f-9b9d-4e80116584bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:18.226938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1234/2461] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:18.236683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:18.238088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:18.294108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16cd42-5754-434b-bc13-f334894dca2a admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:18.297677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173613c8-4246-4d76-96f6-e1257b4ac125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:18.298265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173613c8-4246-4d76-96f6-e1257b4ac125 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:18.298540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173613c8-4246-4d76-96f6-e1257b4ac125 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:18.298809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173613c8-4246-4d76-96f6-e1257b4ac125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:18.307576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173613c8-4246-4d76-96f6-e1257b4ac125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:18.308972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173613c8-4246-4d76-96f6-e1257b4ac125 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:18.318205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1228/2462] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:09:18.745188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a19de-1cdc-4a3f-9b9d-4e80116584bb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:18.746743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f32a19de-1cdc-4a3f-9b9d-4e80116584bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:18.760447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a19de-1cdc-4a3f-9b9d-4e80116584bb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:18.765549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:18.766201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:18.766479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:18.766753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] PATH_INFO: `/v3/projects/02f89737da2e442b837e0c16d3e5cba7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:18.768221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f89737da2e442b837e0c16d3e5cba7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:18.771049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:18.896301 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f89737da2e442b837e0c16d3e5cba7', 'request_id': 'req-ecf814d0-59a9-4960-838d-9783b2162071'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:18.903168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f89737da2e442b837e0c16d3e5cba7', 'request_id': 'req-ecf814d0-59a9-4960-838d-9783b2162071'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:18.974322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f89737da2e442b837e0c16d3e5cba7', 'request_id': 'req-ecf814d0-59a9-4960-838d-9783b2162071'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:18.986434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] The token cache is being invalidate because project 02f89737da2e442b837e0c16d3e5cba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:09:18.986725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:18.987397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:18.988988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1235/2463] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:09:18 2022] DELETE /identity/v3/projects/02f89737da2e442b837e0c16d3e5cba7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:18.993507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173613c8-4246-4d76-96f6-e1257b4ac125 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:19.004352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173613c8-4246-4d76-96f6-e1257b4ac125 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:19.034121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:19.061690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:19.062341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:19.062612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:19.062900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] PATH_INFO: `/v3/users/7234c79b3c4f454c9584b59815d22da3` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:19.063988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7234c79b3c4f454c9584b59815d22da3)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:19.065919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:19.301090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7234c79b3c4f454c9584b59815d22da3'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:19.307985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7234c79b3c4f454c9584b59815d22da3'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:19.319549 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7234c79b3c4f454c9584b59815d22da3'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:19.320220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7234c79b3c4f454c9584b59815d22da3'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:19.320820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7234c79b3c4f454c9584b59815d22da3'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:19.400264 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1229/2464] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:09:18 2022] DELETE /identity/v3/users/7234c79b3c4f454c9584b59815d22da3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:19.830282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:19.831836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:19.847267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf814d0-59a9-4960-838d-9783b2162071 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:19.895989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:19.904862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:19.907902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:19.907902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:19.907902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] PATH_INFO: `/v3/projects/2155dd0bd23d41f59c647ee75453cbe5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:19.907902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2155dd0bd23d41f59c647ee75453cbe5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:19.909202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:20.025931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2155dd0bd23d41f59c647ee75453cbe5', 'request_id': 'req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:20.033372 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2155dd0bd23d41f59c647ee75453cbe5', 'request_id': 'req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:20.122670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2155dd0bd23d41f59c647ee75453cbe5', 'request_id': 'req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:20.134699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] The token cache is being invalidate because project 2155dd0bd23d41f59c647ee75453cbe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:09:20.134993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:20.135632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:20.137196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1236/2465] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:09:19 2022] DELETE /identity/v3/projects/2155dd0bd23d41f59c647ee75453cbe5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:20.141091 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:20.142540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:20.155481 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996aec7-8d55-4958-b7fd-79fffc0a50a6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:20.217069 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:20.217784 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:20.218320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:20.218584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] PATH_INFO: `/v3/users/b43fbfd54c6d4887a33e300b6bc753d4` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:20.219693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43fbfd54c6d4887a33e300b6bc753d4)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:20.221600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:20.457568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43fbfd54c6d4887a33e300b6bc753d4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:20.462425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:20.465491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43fbfd54c6d4887a33e300b6bc753d4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:20.478060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43fbfd54c6d4887a33e300b6bc753d4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:20.478836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43fbfd54c6d4887a33e300b6bc753d4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:20.479504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-7080d31e-60b3-41a9-8596-45a18d581bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43fbfd54c6d4887a33e300b6bc753d4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:20.571895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1230/2466] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:09:20 2022] DELETE /identity/v3/users/b43fbfd54c6d4887a33e300b6bc753d4 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:21.064457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:21.065457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:21.091612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea72ff8-a16b-4ff7-ba40-93c0d142a2d5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:21.201317 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:21.202432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:21.202712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:21.202981 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] PATH_INFO: `/v3/projects/77bfb853ddb540eb9b4f9d542d845034` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:21.204155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77bfb853ddb540eb9b4f9d542d845034)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:21.206172 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:21.343491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77bfb853ddb540eb9b4f9d542d845034', 'request_id': 'req-70a177d3-274f-4946-a3de-37dfac282a97'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:21.350010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77bfb853ddb540eb9b4f9d542d845034', 'request_id': 'req-70a177d3-274f-4946-a3de-37dfac282a97'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:21.431922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77bfb853ddb540eb9b4f9d542d845034', 'request_id': 'req-70a177d3-274f-4946-a3de-37dfac282a97'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:21.443875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] The token cache is being invalidate because project 77bfb853ddb540eb9b4f9d542d845034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:09:21.444936 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:21.445614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-70a177d3-274f-4946-a3de-37dfac282a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:21.447094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1237/2467] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:09:21 2022] DELETE /identity/v3/projects/77bfb853ddb540eb9b4f9d542d845034 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:09:21.451980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a47334-a3e8-4013-81f2-a876d2a47325 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:21.452450 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a47334-a3e8-4013-81f2-a876d2a47325 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:21.457532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a47334-a3e8-4013-81f2-a876d2a47325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:21.471875 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-05a47334-a3e8-4013-81f2-a876d2a47325 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:21.473095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-05a47334-a3e8-4013-81f2-a876d2a47325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:21.533125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1231/2468] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:21.541512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c97e86-8c61-4bf4-911f-8c1e889cf77e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:21.541806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c97e86-8c61-4bf4-911f-8c1e889cf77e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:21.542071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c97e86-8c61-4bf4-911f-8c1e889cf77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:21.562930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-31c97e86-8c61-4bf4-911f-8c1e889cf77e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:21.564394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-31c97e86-8c61-4bf4-911f-8c1e889cf77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:21.573401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1238/2469] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:21.577502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a47334-a3e8-4013-81f2-a876d2a47325 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:21.589219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a47334-a3e8-4013-81f2-a876d2a47325 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:21.612062 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19418f18-54f1-465f-963d-3d18fe6957a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:21.612864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19418f18-54f1-465f-963d-3d18fe6957a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:21.613141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19418f18-54f1-465f-963d-3d18fe6957a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:21.613432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19418f18-54f1-465f-963d-3d18fe6957a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:21.614702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19418f18-54f1-465f-963d-3d18fe6957a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:09:21.615018 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19418f18-54f1-465f-963d-3d18fe6957a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:21.617167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19418f18-54f1-465f-963d-3d18fe6957a0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:21.630714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1232/2470] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:09:21.635742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c97e86-8c61-4bf4-911f-8c1e889cf77e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:21.645694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c97e86-8c61-4bf4-911f-8c1e889cf77e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:21.651265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf354679-11d0-4645-a138-59758081b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:21.652092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf354679-11d0-4645-a138-59758081b675 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:21.652468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf354679-11d0-4645-a138-59758081b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:21.652862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf354679-11d0-4645-a138-59758081b675 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:21.653637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf354679-11d0-4645-a138-59758081b675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:21.656066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf354679-11d0-4645-a138-59758081b675 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:21.661254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:21.773534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1239/2471] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:09:21 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:09:21.780166 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19418f18-54f1-465f-963d-3d18fe6957a0 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:21.791398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19418f18-54f1-465f-963d-3d18fe6957a0 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:21.851349 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a41aab-de41-42d3-b252-b88602892dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:21.851983 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a41aab-de41-42d3-b252-b88602892dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:21.852258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a41aab-de41-42d3-b252-b88602892dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:21.852520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a41aab-de41-42d3-b252-b88602892dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:21.853129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a41aab-de41-42d3-b252-b88602892dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:21.855068 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a41aab-de41-42d3-b252-b88602892dd8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:21.938424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1233/2472] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:09:21 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:09:21.940206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf354679-11d0-4645-a138-59758081b675 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:21.954819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf354679-11d0-4645-a138-59758081b675 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:21.960343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f5be0-1d7f-4f85-8ab7-36859742483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:21.960637 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f5be0-1d7f-4f85-8ab7-36859742483c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:21.961008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f5be0-1d7f-4f85-8ab7-36859742483c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:21.961308 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f5be0-1d7f-4f85-8ab7-36859742483c admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:21.962072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f5be0-1d7f-4f85-8ab7-36859742483c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:21.963673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f5be0-1d7f-4f85-8ab7-36859742483c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:21.974774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1240/2473] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:21.979746 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a41aab-de41-42d3-b252-b88602892dd8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:21.992627 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a41aab-de41-42d3-b252-b88602892dd8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:21.999264 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f799e21-b57e-4e96-9dd6-c3650e31cb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:21.999987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799e21-b57e-4e96-9dd6-c3650e31cb08 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:22.000685 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799e21-b57e-4e96-9dd6-c3650e31cb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:22.006330 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f799e21-b57e-4e96-9dd6-c3650e31cb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:22.006330 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f799e21-b57e-4e96-9dd6-c3650e31cb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:22.006330 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f799e21-b57e-4e96-9dd6-c3650e31cb08 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:22.015850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1234/2474] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:22.020213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f5be0-1d7f-4f85-8ab7-36859742483c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:22.030908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f5be0-1d7f-4f85-8ab7-36859742483c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:22.036054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15ff38-b86f-4ea5-b8d3-88ac0e5b660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:22.036705 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15ff38-b86f-4ea5-b8d3-88ac0e5b660a admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:22.036982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15ff38-b86f-4ea5-b8d3-88ac0e5b660a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:22.040815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15ff38-b86f-4ea5-b8d3-88ac0e5b660a admin admin] PATH_INFO: `/v3/projects/4f29d788139941d5987af962374a436c/users/aa91b689a5e14401a15812c4374fc4cc/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:22.052854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15ff38-b86f-4ea5-b8d3-88ac0e5b660a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f29d788139941d5987af962374a436c, user_id=aa91b689a5e14401a15812c4374fc4cc, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:22.056094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15ff38-b86f-4ea5-b8d3-88ac0e5b660a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:22.157310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1241/2475] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:09:22 2022] PUT /identity/v3/projects/4f29d788139941d5987af962374a436c/users/aa91b689a5e14401a15812c4374fc4cc/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:09:22.168145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68d5ad-5baa-4b63-9d43-0e1c559ea4ee None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:22.168496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68d5ad-5baa-4b63-9d43-0e1c559ea4ee None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:22.168934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68d5ad-5baa-4b63-9d43-0e1c559ea4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:22.233853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9d68d5ad-5baa-4b63-9d43-0e1c559ea4ee None None] MFA Rules not processed for user `aa91b689a5e14401a15812c4374fc4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:22.235060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9d68d5ad-5baa-4b63-9d43-0e1c559ea4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:22.268174 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:22.314257 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1235/2476] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:22.322348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15ff38-b86f-4ea5-b8d3-88ac0e5b660a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:22.323614 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ed15ff38-b86f-4ea5-b8d3-88ac0e5b660a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:22.389565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15ff38-b86f-4ea5-b8d3-88ac0e5b660a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:22.393165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a952f8-a12e-4b22-9b75-c2dd3930b99e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e86be85010d4851a1ce3381832af230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:22.393794 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a952f8-a12e-4b22-9b75-c2dd3930b99e service glance] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:22.394069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a952f8-a12e-4b22-9b75-c2dd3930b99e service glance] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:22.394340 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a952f8-a12e-4b22-9b75-c2dd3930b99e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:22.403646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a952f8-a12e-4b22-9b75-c2dd3930b99e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:22.406071 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a952f8-a12e-4b22-9b75-c2dd3930b99e service glance] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:22.415605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1242/2477] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:09:26.313947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2bfb0-c085-4b28-9db5-94e0796b9891 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:26.314488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2bfb0-c085-4b28-9db5-94e0796b9891 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:26.314488 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2bfb0-c085-4b28-9db5-94e0796b9891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:26.333346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-23e2bfb0-c085-4b28-9db5-94e0796b9891 None None] MFA Rules not processed for user `4d58c48313b74f1685c99cb841e2646d`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:26.335186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-23e2bfb0-c085-4b28-9db5-94e0796b9891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:26.392167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1236/2478] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:27.427578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a952f8-a12e-4b22-9b75-c2dd3930b99e service glance] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:27.429137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a3a952f8-a12e-4b22-9b75-c2dd3930b99e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:27.490330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a952f8-a12e-4b22-9b75-c2dd3930b99e service glance] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:27.494100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69274-040e-4f4d-be11-cebb5c9b3c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:27.494692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69274-040e-4f4d-be11-cebb5c9b3c93 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:27.494968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69274-040e-4f4d-be11-cebb5c9b3c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:27.495234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69274-040e-4f4d-be11-cebb5c9b3c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:27.500035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dba69274-040e-4f4d-be11-cebb5c9b3c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:27.581878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba69274-040e-4f4d-be11-cebb5c9b3c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:27.583298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba69274-040e-4f4d-be11-cebb5c9b3c93 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:27.592977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1243/2479] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:09:35.487006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2bfb0-c085-4b28-9db5-94e0796b9891 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:35.489768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-23e2bfb0-c085-4b28-9db5-94e0796b9891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:35.500212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2bfb0-c085-4b28-9db5-94e0796b9891 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:35.503777 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9168e-0bbd-48f6-bb07-26b29573174f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:35.504372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9168e-0bbd-48f6-bb07-26b29573174f service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:35.504669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9168e-0bbd-48f6-bb07-26b29573174f service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:35.504888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9168e-0bbd-48f6-bb07-26b29573174f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:35.507144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3bf9168e-0bbd-48f6-bb07-26b29573174f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:35.575076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9168e-0bbd-48f6-bb07-26b29573174f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:35.576855 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9168e-0bbd-48f6-bb07-26b29573174f service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:35.587428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1237/2480] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:09:37.588810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:43.888877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69274-040e-4f4d-be11-cebb5c9b3c93 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:43.890357 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dba69274-040e-4f4d-be11-cebb5c9b3c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:43.922741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69274-040e-4f4d-be11-cebb5c9b3c93 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:43.930807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:43.933110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:43.933110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:43.933110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] PATH_INFO: `/v3/users/899beb2011834ecca7f0a4a40a192950` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:43.933938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=899beb2011834ecca7f0a4a40a192950)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:43.936173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:44.171534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899beb2011834ecca7f0a4a40a192950'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:44.183974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899beb2011834ecca7f0a4a40a192950'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:44.185776 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899beb2011834ecca7f0a4a40a192950'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:44.186330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899beb2011834ecca7f0a4a40a192950'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:44.277362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899beb2011834ecca7f0a4a40a192950'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:44.290815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1244/2481] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:09:43 2022] DELETE /identity/v3/users/899beb2011834ecca7f0a4a40a192950 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:44.525701 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9168e-0bbd-48f6-bb07-26b29573174f service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:44.536906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9168e-0bbd-48f6-bb07-26b29573174f service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:44.607454 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:44.608095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:44.608394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:44.608665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] PATH_INFO: `/v3/projects/1f366a209ccf480eaa0ba53e36586fbf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:44.609832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f366a209ccf480eaa0ba53e36586fbf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:44.611730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:44.619469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:44.751490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f366a209ccf480eaa0ba53e36586fbf', 'request_id': 'req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:44.758868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f366a209ccf480eaa0ba53e36586fbf', 'request_id': 'req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:44.825750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f366a209ccf480eaa0ba53e36586fbf', 'request_id': 'req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:44.837548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] The token cache is being invalidate because project 1f366a209ccf480eaa0ba53e36586fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:09:44.837834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:44.838459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:44.840180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1238/2482] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:09:44 2022] DELETE /identity/v3/projects/1f366a209ccf480eaa0ba53e36586fbf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:44.844154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:44.845700 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:44.859374 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0b60a-fca3-4d2b-ab4d-6cff8dd1d75f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:44.916473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:44.917138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:44.917415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:44.917695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] PATH_INFO: `/v3/users/c7caa408d3cf492da529f752237f083a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:44.918870 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7caa408d3cf492da529f752237f083a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:44.920803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:45.136643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7caa408d3cf492da529f752237f083a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:45.149362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7caa408d3cf492da529f752237f083a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:45.150088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7caa408d3cf492da529f752237f083a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:45.150707 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7caa408d3cf492da529f752237f083a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:45.237449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7caa408d3cf492da529f752237f083a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:45.240035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:45.253627 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1245/2483] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:09:44 2022] DELETE /identity/v3/users/c7caa408d3cf492da529f752237f083a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:45.517120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:45.518673 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:45.534217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d8ab4-2f5b-4204-a1e7-ea4e81f9cbb1 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:45.606196 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:45.606906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:45.607248 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:45.607653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] PATH_INFO: `/v3/projects/5b9eac8805104865bf169dfbbababbc4` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:45.609008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9eac8805104865bf169dfbbababbc4)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:45.611333 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:45.743249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9eac8805104865bf169dfbbababbc4', 'request_id': 'req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:45.752607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9eac8805104865bf169dfbbababbc4', 'request_id': 'req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:45.820697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9eac8805104865bf169dfbbababbc4', 'request_id': 'req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:45.837371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] The token cache is being invalidate because project 5b9eac8805104865bf169dfbbababbc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:09:45.837708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:45.838350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:45.839904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1239/2484] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:09:45 2022] DELETE /identity/v3/projects/5b9eac8805104865bf169dfbbababbc4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:50.200434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:50.201901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:50.257730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47463150-72a3-4e14-bde4-9ec5305991d2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:50.304311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22436ff-079b-4e4a-94e2-7900089bc574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:50.304834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22436ff-079b-4e4a-94e2-7900089bc574 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:50.305108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22436ff-079b-4e4a-94e2-7900089bc574 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:50.305406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22436ff-079b-4e4a-94e2-7900089bc574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:50.307211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c22436ff-079b-4e4a-94e2-7900089bc574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:50.369815 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22436ff-079b-4e4a-94e2-7900089bc574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:50.371238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22436ff-079b-4e4a-94e2-7900089bc574 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:50.380653 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1246/2485] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:09:54.004144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:54.005631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:54.018781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9ebce-66c8-4e7f-8b49-3acf8c98bbd6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:54.023443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:54.024581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:54.024861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:54.025134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] PATH_INFO: `/v3/users/03403068f7da491499f2a62ad218159e` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:54.026272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03403068f7da491499f2a62ad218159e)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:54.028293 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:54.050073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:54.234130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03403068f7da491499f2a62ad218159e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:54.241043 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03403068f7da491499f2a62ad218159e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:54.252551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03403068f7da491499f2a62ad218159e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:54.253225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03403068f7da491499f2a62ad218159e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:54.253910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5df0154e-67d8-4ad3-975b-fbc4b0d25644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03403068f7da491499f2a62ad218159e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:54.331419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1240/2486] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:09:54 2022] DELETE /identity/v3/users/03403068f7da491499f2a62ad218159e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:09:54.574442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22436ff-079b-4e4a-94e2-7900089bc574 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:54.584533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22436ff-079b-4e4a-94e2-7900089bc574 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:54.639251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:54.645173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:54.648196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:54.648196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:54.648196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] PATH_INFO: `/v3/projects/3abe10b2412747d09e07b5ae7a72071f` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:54.648196 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abe10b2412747d09e07b5ae7a72071f)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:54.649999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:54.780434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abe10b2412747d09e07b5ae7a72071f', 'request_id': 'req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:54.786537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abe10b2412747d09e07b5ae7a72071f', 'request_id': 'req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:54.888528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abe10b2412747d09e07b5ae7a72071f', 'request_id': 'req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:54.898861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] The token cache is being invalidate because project 3abe10b2412747d09e07b5ae7a72071f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:09:54.899142 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:54.900249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:54.901754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1247/2487] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:09:54 2022] DELETE /identity/v3/projects/3abe10b2412747d09e07b5ae7a72071f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:09:54.906625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dce68-0ca1-4d95-9e6c-68afb752f676 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:54.906913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dce68-0ca1-4d95-9e6c-68afb752f676 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:54.907188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dce68-0ca1-4d95-9e6c-68afb752f676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:54.927600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-179dce68-0ca1-4d95-9e6c-68afb752f676 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:54.928788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-179dce68-0ca1-4d95-9e6c-68afb752f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:54.976420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:54.978849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:54.993382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1241/2488] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:55.001210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812caa0-d125-4efd-a443-d4d0c9ac744a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.001617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812caa0-d125-4efd-a443-d4d0c9ac744a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.001895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812caa0-d125-4efd-a443-d4d0c9ac744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.022071 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f812caa0-d125-4efd-a443-d4d0c9ac744a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:55.023275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f812caa0-d125-4efd-a443-d4d0c9ac744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:55.031690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1242/2489] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:09:55.035781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812caa0-d125-4efd-a443-d4d0c9ac744a None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:55.045226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812caa0-d125-4efd-a443-d4d0c9ac744a None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:55.050516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e2442-ab5f-4957-89f1-7715182b9c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:55.051089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e2442-ab5f-4957-89f1-7715182b9c8b admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.051235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea1e7e-fd89-4adf-99ca-8d5f9753b24e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:55.051387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e2442-ab5f-4957-89f1-7715182b9c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.051635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e2442-ab5f-4957-89f1-7715182b9c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.052251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e2442-ab5f-4957-89f1-7715182b9c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:09:55.052550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e2442-ab5f-4957-89f1-7715182b9c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:55.054138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e2442-ab5f-4957-89f1-7715182b9c8b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:55.055839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:55.056459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.056734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.057000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] PATH_INFO: `/v3/users/aa91b689a5e14401a15812c4374fc4cc` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.058156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa91b689a5e14401a15812c4374fc4cc)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:55.060050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:55.065574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1243/2490] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:09:55.069548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e2442-ab5f-4957-89f1-7715182b9c8b admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:55.079596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e2442-ab5f-4957-89f1-7715182b9c8b admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:55.084177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efded85c-b0b0-4643-a196-24d49b9ff53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:55.084751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efded85c-b0b0-4643-a196-24d49b9ff53a admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.085026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efded85c-b0b0-4643-a196-24d49b9ff53a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.085321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efded85c-b0b0-4643-a196-24d49b9ff53a admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.085927 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efded85c-b0b0-4643-a196-24d49b9ff53a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:55.088484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efded85c-b0b0-4643-a196-24d49b9ff53a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:55.230754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1244/2491] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:09:55 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:09:55.234647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efded85c-b0b0-4643-a196-24d49b9ff53a admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:55.282678 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa91b689a5e14401a15812c4374fc4cc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:55.293716 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:55.298410 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efded85c-b0b0-4643-a196-24d49b9ff53a admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:55.303142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a832e-ea1c-4e1b-a785-f34d2f24e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:55.303904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a832e-ea1c-4e1b-a785-f34d2f24e1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.304197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a832e-ea1c-4e1b-a785-f34d2f24e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.304509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a832e-ea1c-4e1b-a785-f34d2f24e1b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.305040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa91b689a5e14401a15812c4374fc4cc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:55.305159 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a832e-ea1c-4e1b-a785-f34d2f24e1b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:55.305800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa91b689a5e14401a15812c4374fc4cc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:55.306400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa91b689a5e14401a15812c4374fc4cc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:55.307065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a832e-ea1c-4e1b-a785-f34d2f24e1b4 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:55.371848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d0a503d7-15ea-409a-8961-66d7342c072e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa91b689a5e14401a15812c4374fc4cc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:55.385129 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1248/2492] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:09:54 2022] DELETE /identity/v3/users/aa91b689a5e14401a15812c4374fc4cc => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:55.389316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6441f-16dd-4a27-81be-7418e063a90f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.389609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6441f-16dd-4a27-81be-7418e063a90f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.389877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6441f-16dd-4a27-81be-7418e063a90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.405218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1245/2493] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:09:55 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:09:55.405439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:55.406512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a832e-ea1c-4e1b-a785-f34d2f24e1b4 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:55.408269 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fe2a832e-ea1c-4e1b-a785-f34d2f24e1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:55.409683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-14d6441f-16dd-4a27-81be-7418e063a90f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:55.410873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-14d6441f-16dd-4a27-81be-7418e063a90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:55.420244 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a832e-ea1c-4e1b-a785-f34d2f24e1b4 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:55.469908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1249/2494] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:09:55.475208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840413a8-b5e4-4c3e-b706-a7bb4da9b956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:55.475824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840413a8-b5e4-4c3e-b706-a7bb4da9b956 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.476098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840413a8-b5e4-4c3e-b706-a7bb4da9b956 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.476373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840413a8-b5e4-4c3e-b706-a7bb4da9b956 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.476997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840413a8-b5e4-4c3e-b706-a7bb4da9b956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:55.478677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840413a8-b5e4-4c3e-b706-a7bb4da9b956 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:55.481553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6441f-16dd-4a27-81be-7418e063a90f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:55.483244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-14d6441f-16dd-4a27-81be-7418e063a90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:55.489583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1246/2495] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:55.500028 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840413a8-b5e4-4c3e-b706-a7bb4da9b956 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:55.510271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840413a8-b5e4-4c3e-b706-a7bb4da9b956 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:55.515289 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62408c-a23b-4cbf-a066-b78cf81593d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:55.515881 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62408c-a23b-4cbf-a066-b78cf81593d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.516206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62408c-a23b-4cbf-a066-b78cf81593d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.517500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62408c-a23b-4cbf-a066-b78cf81593d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.520198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62408c-a23b-4cbf-a066-b78cf81593d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:55.520198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62408c-a23b-4cbf-a066-b78cf81593d3 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:55.530344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1247/2496] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:09:55.534440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62408c-a23b-4cbf-a066-b78cf81593d3 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:55.544066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62408c-a23b-4cbf-a066-b78cf81593d3 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:55.549189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6441f-16dd-4a27-81be-7418e063a90f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:55.549189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744f1ac-f1ec-4238-b01e-795379aac950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:55.549494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a04e-f0cf-448a-a96e-6a2cceceaadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:55.549606 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f1ac-f1ec-4238-b01e-795379aac950 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.549699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a04e-f0cf-448a-a96e-6a2cceceaadc admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.549788 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f1ac-f1ec-4238-b01e-795379aac950 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.549892 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a04e-f0cf-448a-a96e-6a2cceceaadc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.549982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f1ac-f1ec-4238-b01e-795379aac950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.550089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a04e-f0cf-448a-a96e-6a2cceceaadc admin admin] PATH_INFO: `/v3/projects/651eeb38526f4faab4a6eb42880726bc/users/4417fbe5851d47c79bd35de3069ad743/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.559541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744f1ac-f1ec-4238-b01e-795379aac950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:55.560970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744f1ac-f1ec-4238-b01e-795379aac950 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:55.567954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85a04e-f0cf-448a-a96e-6a2cceceaadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=651eeb38526f4faab4a6eb42880726bc, user_id=4417fbe5851d47c79bd35de3069ad743, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:55.570537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1250/2497] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:09:55.570659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85a04e-f0cf-448a-a96e-6a2cceceaadc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:55.630233 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1248/2498] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:09:55 2022] PUT /identity/v3/projects/651eeb38526f4faab4a6eb42880726bc/users/4417fbe5851d47c79bd35de3069ad743/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:09:55.645618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e89b8-fffc-4567-bd8c-2a261f8b0821 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.645618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e89b8-fffc-4567-bd8c-2a261f8b0821 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.645618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e89b8-fffc-4567-bd8c-2a261f8b0821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.675032 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-370e89b8-fffc-4567-bd8c-2a261f8b0821 None None] MFA Rules not processed for user `4417fbe5851d47c79bd35de3069ad743`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:55.680571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-370e89b8-fffc-4567-bd8c-2a261f8b0821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:55.739969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1251/2499] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:55.751472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a04e-f0cf-448a-a96e-6a2cceceaadc admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:55.753373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7f85a04e-f0cf-448a-a96e-6a2cceceaadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:55.832260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a04e-f0cf-448a-a96e-6a2cceceaadc admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:55.838748 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6bdd5-3e81-4f08-950e-5f002ecdda6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:55.839348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6bdd5-3e81-4f08-950e-5f002ecdda6d service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:55.839640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6bdd5-3e81-4f08-950e-5f002ecdda6d service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:55.839893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6bdd5-3e81-4f08-950e-5f002ecdda6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:55.847848 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6bdd5-3e81-4f08-950e-5f002ecdda6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:55.849432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6bdd5-3e81-4f08-950e-5f002ecdda6d service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:55.858171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1249/2500] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:09:55.976792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e89b8-fffc-4567-bd8c-2a261f8b0821 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:55.978289 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-370e89b8-fffc-4567-bd8c-2a261f8b0821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:56.033532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:56.053922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e89b8-fffc-4567-bd8c-2a261f8b0821 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:56.058401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:56.059011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:56.059282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:56.059546 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] PATH_INFO: `/v3/projects/4f29d788139941d5987af962374a436c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:56.060625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f29d788139941d5987af962374a436c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:56.062536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:56.173898 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f29d788139941d5987af962374a436c', 'request_id': 'req-d43d2f80-c858-4349-9494-8044b2a50577'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:56.180053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f29d788139941d5987af962374a436c', 'request_id': 'req-d43d2f80-c858-4349-9494-8044b2a50577'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:56.260636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f29d788139941d5987af962374a436c', 'request_id': 'req-d43d2f80-c858-4349-9494-8044b2a50577'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:56.272726 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] The token cache is being invalidate because project 4f29d788139941d5987af962374a436c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:09:56.272726 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:56.272726 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d43d2f80-c858-4349-9494-8044b2a50577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:09:56.274046 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1252/2501] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:09:55 2022] DELETE /identity/v3/projects/4f29d788139941d5987af962374a436c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:56.279886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d764-854c-49d1-a4d2-d850947033b8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:56.280351 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d764-854c-49d1-a4d2-d850947033b8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:56.280445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d764-854c-49d1-a4d2-d850947033b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:56.299304 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b607d764-854c-49d1-a4d2-d850947033b8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:56.300477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b607d764-854c-49d1-a4d2-d850947033b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:56.326704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:56.363730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1250/2502] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:56.367461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f0ada-0f12-4e21-8121-38eb199e26d0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:56.367748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f0ada-0f12-4e21-8121-38eb199e26d0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:56.368535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f0ada-0f12-4e21-8121-38eb199e26d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:56.388240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-782f0ada-0f12-4e21-8121-38eb199e26d0 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:56.389449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-782f0ada-0f12-4e21-8121-38eb199e26d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:56.397303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1253/2503] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:56.401551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d764-854c-49d1-a4d2-d850947033b8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:56.410971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d764-854c-49d1-a4d2-d850947033b8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:56.415383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63394c-2821-4fc5-9b6c-be4226659c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:56.415961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63394c-2821-4fc5-9b6c-be4226659c67 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:56.416229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63394c-2821-4fc5-9b6c-be4226659c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:56.416491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63394c-2821-4fc5-9b6c-be4226659c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:56.417112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63394c-2821-4fc5-9b6c-be4226659c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:09:56.417443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63394c-2821-4fc5-9b6c-be4226659c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:56.418997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63394c-2821-4fc5-9b6c-be4226659c67 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:56.429812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1251/2504] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:09:56.435978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f0ada-0f12-4e21-8121-38eb199e26d0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:56.445241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f0ada-0f12-4e21-8121-38eb199e26d0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:56.450610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817ad9d-d111-4112-aaca-24a7b95324f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:56.451198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ad9d-d111-4112-aaca-24a7b95324f5 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:56.451472 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ad9d-d111-4112-aaca-24a7b95324f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:56.451739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ad9d-d111-4112-aaca-24a7b95324f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:56.452345 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817ad9d-d111-4112-aaca-24a7b95324f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:56.454299 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817ad9d-d111-4112-aaca-24a7b95324f5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:56.577324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1254/2505] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:09:56 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:09:56.586110 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63394c-2821-4fc5-9b6c-be4226659c67 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:56.599048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63394c-2821-4fc5-9b6c-be4226659c67 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:56.662889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab8d28-7d40-424f-ab3c-d120144c7d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:56.663495 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab8d28-7d40-424f-ab3c-d120144c7d08 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:56.663773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab8d28-7d40-424f-ab3c-d120144c7d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:56.664044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab8d28-7d40-424f-ab3c-d120144c7d08 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:56.664658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab8d28-7d40-424f-ab3c-d120144c7d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:56.667101 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab8d28-7d40-424f-ab3c-d120144c7d08 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:56.807327 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1252/2506] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:09:56 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:09:56.811386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817ad9d-d111-4112-aaca-24a7b95324f5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:56.821379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817ad9d-d111-4112-aaca-24a7b95324f5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:56.826063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd49b5-4b19-4422-860b-993d8149c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:56.826673 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd49b5-4b19-4422-860b-993d8149c0df admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:56.826944 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd49b5-4b19-4422-860b-993d8149c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:56.827214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd49b5-4b19-4422-860b-993d8149c0df admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:56.827837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd49b5-4b19-4422-860b-993d8149c0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:56.829445 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd49b5-4b19-4422-860b-993d8149c0df admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:56.839011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1255/2507] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:56.842705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab8d28-7d40-424f-ab3c-d120144c7d08 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:56.853581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab8d28-7d40-424f-ab3c-d120144c7d08 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:56.858203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226eeef-b089-4ed0-b11c-a251708d1fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:56.858772 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226eeef-b089-4ed0-b11c-a251708d1fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:56.859044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226eeef-b089-4ed0-b11c-a251708d1fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:56.859310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226eeef-b089-4ed0-b11c-a251708d1fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:56.859936 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226eeef-b089-4ed0-b11c-a251708d1fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:56.861545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226eeef-b089-4ed0-b11c-a251708d1fd0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:56.872626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1253/2508] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:09:56.876698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd49b5-4b19-4422-860b-993d8149c0df admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:56.886585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd49b5-4b19-4422-860b-993d8149c0df admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:56.890987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228470b6-13c4-4712-bbee-7164370fa036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:56.896123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228470b6-13c4-4712-bbee-7164370fa036 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:56.896123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228470b6-13c4-4712-bbee-7164370fa036 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:56.896123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228470b6-13c4-4712-bbee-7164370fa036 admin admin] PATH_INFO: `/v3/projects/577a9a861a2a435c87115bbaa13f1c24/users/caac71d5134e4bacbc2dc28baf0c984d/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:56.909471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228470b6-13c4-4712-bbee-7164370fa036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577a9a861a2a435c87115bbaa13f1c24, user_id=caac71d5134e4bacbc2dc28baf0c984d, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:56.912622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228470b6-13c4-4712-bbee-7164370fa036 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:57.024267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1256/2509] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:09:56 2022] PUT /identity/v3/projects/577a9a861a2a435c87115bbaa13f1c24/users/caac71d5134e4bacbc2dc28baf0c984d/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:09:57.032157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d3ae5-7568-4428-8062-aa85075a6def None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:57.032387 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d3ae5-7568-4428-8062-aa85075a6def None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:57.032654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d3ae5-7568-4428-8062-aa85075a6def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:57.051890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-4a6d3ae5-7568-4428-8062-aa85075a6def None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:09:57.053066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4a6d3ae5-7568-4428-8062-aa85075a6def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:57.110464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1254/2510] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:09:57.120503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228470b6-13c4-4712-bbee-7164370fa036 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:09:57.122266 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-228470b6-13c4-4712-bbee-7164370fa036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:09:57.177663 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228470b6-13c4-4712-bbee-7164370fa036 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:09:57.181742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829039a-e8db-4b5c-b72a-4586d853e915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:09:57.182329 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829039a-e8db-4b5c-b72a-4586d853e915 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:09:57.182599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829039a-e8db-4b5c-b72a-4586d853e915 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:09:57.182866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829039a-e8db-4b5c-b72a-4586d853e915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:09:57.191620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829039a-e8db-4b5c-b72a-4586d853e915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:09:57.193065 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829039a-e8db-4b5c-b72a-4586d853e915 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:09:57.202819 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1257/2511] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:02.201691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d3ae5-7568-4428-8062-aa85075a6def None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:02.203045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4a6d3ae5-7568-4428-8062-aa85075a6def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:02.216328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d3ae5-7568-4428-8062-aa85075a6def None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:02.220955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:02.221668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:02.221978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:02.222253 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] PATH_INFO: `/v3/users/4417fbe5851d47c79bd35de3069ad743` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:02.223447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4417fbe5851d47c79bd35de3069ad743)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:02.225805 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:02.409107 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:02.422937 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4417fbe5851d47c79bd35de3069ad743'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:02.431389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4417fbe5851d47c79bd35de3069ad743'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:02.445203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4417fbe5851d47c79bd35de3069ad743'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:02.446050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4417fbe5851d47c79bd35de3069ad743'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:02.447382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4417fbe5851d47c79bd35de3069ad743'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:02.523658 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1255/2512] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:02 2022] DELETE /identity/v3/users/4417fbe5851d47c79bd35de3069ad743 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:02.527821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc808e-4720-4130-9253-922cf494aabf None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:02.528323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc808e-4720-4130-9253-922cf494aabf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:02.528426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc808e-4720-4130-9253-922cf494aabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:02.548920 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7cfc808e-4720-4130-9253-922cf494aabf None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:02.551390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7cfc808e-4720-4130-9253-922cf494aabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:02.557194 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:02.619790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1258/2513] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:02.632487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:02.632487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:02.713864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55809703-cab5-49c5-bf61-a3c8e4c12c0b admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:02.717496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47481d5e-e243-4f59-98ff-62dcfbba07a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:02.718094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47481d5e-e243-4f59-98ff-62dcfbba07a0 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:02.718376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47481d5e-e243-4f59-98ff-62dcfbba07a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:02.718610 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47481d5e-e243-4f59-98ff-62dcfbba07a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:02.730556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47481d5e-e243-4f59-98ff-62dcfbba07a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:02.734445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47481d5e-e243-4f59-98ff-62dcfbba07a0 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:02.747831 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1256/2514] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:02.890804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e226f-eff1-4971-94e2-d71fbe8ac996 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:02.891089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e226f-eff1-4971-94e2-d71fbe8ac996 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:02.891543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e226f-eff1-4971-94e2-d71fbe8ac996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:02.920899 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1f7e226f-eff1-4971-94e2-d71fbe8ac996 None None] MFA Rules not processed for user `caac71d5134e4bacbc2dc28baf0c984d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:02.922348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1f7e226f-eff1-4971-94e2-d71fbe8ac996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:02.989642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1259/2515] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:02.994120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47481d5e-e243-4f59-98ff-62dcfbba07a0 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:02.996812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-47481d5e-e243-4f59-98ff-62dcfbba07a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:03.013975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47481d5e-e243-4f59-98ff-62dcfbba07a0 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:03.018794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2a6ee-0061-4824-9bea-cb0e8e1bbb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:03.026341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2a6ee-0061-4824-9bea-cb0e8e1bbb9d admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.026341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2a6ee-0061-4824-9bea-cb0e8e1bbb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.026341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2a6ee-0061-4824-9bea-cb0e8e1bbb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.026341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2a6ee-0061-4824-9bea-cb0e8e1bbb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:03.026341 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2a6ee-0061-4824-9bea-cb0e8e1bbb9d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:03.120606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1257/2516] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:02 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:03.124893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e226f-eff1-4971-94e2-d71fbe8ac996 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:03.144760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e226f-eff1-4971-94e2-d71fbe8ac996 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:03.201853 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a344c-1baa-4291-9ea8-608ce6afe18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:03.202695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a344c-1baa-4291-9ea8-608ce6afe18a admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.202977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a344c-1baa-4291-9ea8-608ce6afe18a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.203248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a344c-1baa-4291-9ea8-608ce6afe18a admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.203864 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a344c-1baa-4291-9ea8-608ce6afe18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:03.205809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a344c-1baa-4291-9ea8-608ce6afe18a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:03.244813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2a6ee-0061-4824-9bea-cb0e8e1bbb9d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:03.246627 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f6c2a6ee-0061-4824-9bea-cb0e8e1bbb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:03.259347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2a6ee-0061-4824-9bea-cb0e8e1bbb9d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:03.264994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:03.265877 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.270283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.270283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] PATH_INFO: `/v3/projects/651eeb38526f4faab4a6eb42880726bc` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.270283 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=651eeb38526f4faab4a6eb42880726bc)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:03.273216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:03.323571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1260/2517] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:03 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:03.327606 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a344c-1baa-4291-9ea8-608ce6afe18a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:03.337541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a344c-1baa-4291-9ea8-608ce6afe18a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:03.342347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e913055-d1aa-4fae-ad9c-dae55a51b8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:03.342947 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913055-d1aa-4fae-ad9c-dae55a51b8be admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.343221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913055-d1aa-4fae-ad9c-dae55a51b8be admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.343557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e913055-d1aa-4fae-ad9c-dae55a51b8be admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.344202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e913055-d1aa-4fae-ad9c-dae55a51b8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:03.346098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e913055-d1aa-4fae-ad9c-dae55a51b8be admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:03.356478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1261/2518] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:10:03.360713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e913055-d1aa-4fae-ad9c-dae55a51b8be admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:03.370649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e913055-d1aa-4fae-ad9c-dae55a51b8be admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:03.375310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f70a1-4752-4aec-a93e-7b606d369270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:03.375946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f70a1-4752-4aec-a93e-7b606d369270 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.376222 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f70a1-4752-4aec-a93e-7b606d369270 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.376494 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f70a1-4752-4aec-a93e-7b606d369270 admin admin] PATH_INFO: `/v3/projects/f837919961d54b61aebf1df5b51ecc87/users/e7957b745a2540a88f3c2fc042ac43a5/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.390381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651eeb38526f4faab4a6eb42880726bc', 'request_id': 'req-035459a3-2fbc-4d70-9aaf-f1fe311c9055'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:03.391491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f70a1-4752-4aec-a93e-7b606d369270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f837919961d54b61aebf1df5b51ecc87, user_id=e7957b745a2540a88f3c2fc042ac43a5, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:03.394141 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f70a1-4752-4aec-a93e-7b606d369270 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:03.396300 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:03.398389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651eeb38526f4faab4a6eb42880726bc', 'request_id': 'req-035459a3-2fbc-4d70-9aaf-f1fe311c9055'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:03.477168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651eeb38526f4faab4a6eb42880726bc', 'request_id': 'req-035459a3-2fbc-4d70-9aaf-f1fe311c9055'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:03.483125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1262/2519] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:03 2022] PUT /identity/v3/projects/f837919961d54b61aebf1df5b51ecc87/users/e7957b745a2540a88f3c2fc042ac43a5/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:03.486798 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f70a1-4752-4aec-a93e-7b606d369270 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:03.489184 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] The token cache is being invalidate because project 651eeb38526f4faab4a6eb42880726bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:03.489621 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:03.491098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-035459a3-2fbc-4d70-9aaf-f1fe311c9055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:03.492940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1258/2520] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:03 2022] DELETE /identity/v3/projects/651eeb38526f4faab4a6eb42880726bc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:10:03.498859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb05e8-97fe-446a-aeb2-fd0e3dc89da4 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.499336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb05e8-97fe-446a-aeb2-fd0e3dc89da4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.499767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb05e8-97fe-446a-aeb2-fd0e3dc89da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.522931 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-eabb05e8-97fe-446a-aeb2-fd0e3dc89da4 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:03.524825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-eabb05e8-97fe-446a-aeb2-fd0e3dc89da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:03.537210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:03.557414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f70a1-4752-4aec-a93e-7b606d369270 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:03.562314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be5b09-ba94-4fa5-a3f2-3885613eedb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:03.562937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be5b09-ba94-4fa5-a3f2-3885613eedb4 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.563217 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be5b09-ba94-4fa5-a3f2-3885613eedb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.563486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be5b09-ba94-4fa5-a3f2-3885613eedb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.564151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be5b09-ba94-4fa5-a3f2-3885613eedb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:03.565797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be5b09-ba94-4fa5-a3f2-3885613eedb4 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:03.576854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1263/2521] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:10:03.580895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be5b09-ba94-4fa5-a3f2-3885613eedb4 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:03.582532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-90be5b09-ba94-4fa5-a3f2-3885613eedb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:03.596602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be5b09-ba94-4fa5-a3f2-3885613eedb4 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:03.601166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9887931-4994-4657-9a57-67440c8861e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:03.601845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9887931-4994-4657-9a57-67440c8861e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.602013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1259/2522] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:03.602120 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9887931-4994-4657-9a57-67440c8861e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.602404 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9887931-4994-4657-9a57-67440c8861e7 admin admin] PATH_INFO: `/v3/projects/f837919961d54b61aebf1df5b51ecc87/users/e7957b745a2540a88f3c2fc042ac43a5/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.604334 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9887931-4994-4657-9a57-67440c8861e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f837919961d54b61aebf1df5b51ecc87, user_id=e7957b745a2540a88f3c2fc042ac43a5, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:03.607004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9887931-4994-4657-9a57-67440c8861e7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:03.609727 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff807ee-975e-4b3f-af5d-af64e54703d3 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.610192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff807ee-975e-4b3f-af5d-af64e54703d3 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.617622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff807ee-975e-4b3f-af5d-af64e54703d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.623060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1264/2523] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:03 2022] PUT /identity/v3/projects/f837919961d54b61aebf1df5b51ecc87/users/e7957b745a2540a88f3c2fc042ac43a5/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:10:03.632579 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-dff807ee-975e-4b3f-af5d-af64e54703d3 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:03.634560 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-dff807ee-975e-4b3f-af5d-af64e54703d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:03.714757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1260/2524] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:10:03.719062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9887931-4994-4657-9a57-67440c8861e7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:03.734023 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9887931-4994-4657-9a57-67440c8861e7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:03.736330 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd055-a429-4c55-829d-cd0b3ee2d5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:03.736927 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd055-a429-4c55-829d-cd0b3ee2d5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.737352 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd055-a429-4c55-829d-cd0b3ee2d5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.737628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd055-a429-4c55-829d-cd0b3ee2d5c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.738262 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fd055-a429-4c55-829d-cd0b3ee2d5c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:10:03.738573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fd055-a429-4c55-829d-cd0b3ee2d5c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:03.740137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fd055-a429-4c55-829d-cd0b3ee2d5c5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:03.752842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1265/2525] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:10:03.757437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff807ee-975e-4b3f-af5d-af64e54703d3 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:03.768808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff807ee-975e-4b3f-af5d-af64e54703d3 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:03.773784 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02d385-ee8d-43d4-9edb-8dd208c3cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:03.774592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d385-ee8d-43d4-9edb-8dd208c3cf0f admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:03.774926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d385-ee8d-43d4-9edb-8dd208c3cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:03.775251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d385-ee8d-43d4-9edb-8dd208c3cf0f admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:03.775942 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02d385-ee8d-43d4-9edb-8dd208c3cf0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:03.777925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02d385-ee8d-43d4-9edb-8dd208c3cf0f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:03.887075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1261/2526] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:03 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:03.891276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd055-a429-4c55-829d-cd0b3ee2d5c5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:03.902197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd055-a429-4c55-829d-cd0b3ee2d5c5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:04.017446 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edf0c4-6169-4bc0-af53-1ad4cd4f3efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:04.018206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edf0c4-6169-4bc0-af53-1ad4cd4f3efb admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:04.018794 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edf0c4-6169-4bc0-af53-1ad4cd4f3efb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:04.018906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edf0c4-6169-4bc0-af53-1ad4cd4f3efb admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:04.020134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edf0c4-6169-4bc0-af53-1ad4cd4f3efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:04.022098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edf0c4-6169-4bc0-af53-1ad4cd4f3efb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:04.121392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1266/2527] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:03 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:04.123063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02d385-ee8d-43d4-9edb-8dd208c3cf0f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:04.133859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02d385-ee8d-43d4-9edb-8dd208c3cf0f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:04.140310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cdf74-01bf-465b-bfa1-a555cfae3e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:04.141044 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cdf74-01bf-465b-bfa1-a555cfae3e90 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:04.141425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cdf74-01bf-465b-bfa1-a555cfae3e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:04.141683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3cdf74-01bf-465b-bfa1-a555cfae3e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:04.142561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cdf74-01bf-465b-bfa1-a555cfae3e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:04.148355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3cdf74-01bf-465b-bfa1-a555cfae3e90 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:04.154639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1262/2528] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:04.158639 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edf0c4-6169-4bc0-af53-1ad4cd4f3efb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:04.169318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edf0c4-6169-4bc0-af53-1ad4cd4f3efb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:04.177987 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a0292-5e15-485f-a0fe-cfa7690c9515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:04.181946 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a0292-5e15-485f-a0fe-cfa7690c9515 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:04.183237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a0292-5e15-485f-a0fe-cfa7690c9515 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:04.184016 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a0292-5e15-485f-a0fe-cfa7690c9515 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:04.185144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a0292-5e15-485f-a0fe-cfa7690c9515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:04.187134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a0292-5e15-485f-a0fe-cfa7690c9515 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:04.205796 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1267/2529] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:04.211143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cdf74-01bf-465b-bfa1-a555cfae3e90 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:04.234948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3cdf74-01bf-465b-bfa1-a555cfae3e90 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:04.241824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a065636-cb29-4b5f-9352-72e8a5e01cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:04.242665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a065636-cb29-4b5f-9352-72e8a5e01cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:04.243503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a065636-cb29-4b5f-9352-72e8a5e01cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:04.243850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a065636-cb29-4b5f-9352-72e8a5e01cfc admin admin] PATH_INFO: `/v3/projects/c4f4b259abc34581a41af18f5ae66bd8/users/419aa51859404ffaa3c951195e084b6c/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:04.261888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a065636-cb29-4b5f-9352-72e8a5e01cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f4b259abc34581a41af18f5ae66bd8, user_id=419aa51859404ffaa3c951195e084b6c, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:04.265189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a065636-cb29-4b5f-9352-72e8a5e01cfc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:04.341226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1263/2530] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:04 2022] PUT /identity/v3/projects/c4f4b259abc34581a41af18f5ae66bd8/users/419aa51859404ffaa3c951195e084b6c/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:04.351938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57d25-115b-4372-a48d-4f5dabdd9544 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:04.352779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57d25-115b-4372-a48d-4f5dabdd9544 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:04.353053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c57d25-115b-4372-a48d-4f5dabdd9544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:04.380828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-89c57d25-115b-4372-a48d-4f5dabdd9544 None None] MFA Rules not processed for user `419aa51859404ffaa3c951195e084b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:04.381944 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-89c57d25-115b-4372-a48d-4f5dabdd9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:04.410309 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:04.444269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1268/2531] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:04.456079 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a065636-cb29-4b5f-9352-72e8a5e01cfc admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:04.458109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4a065636-cb29-4b5f-9352-72e8a5e01cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:04.528130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:04.561858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a065636-cb29-4b5f-9352-72e8a5e01cfc admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:04.568830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5237188-8aa1-4703-bdbe-cd92538211ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:04.569155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5237188-8aa1-4703-bdbe-cd92538211ce service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:04.569708 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5237188-8aa1-4703-bdbe-cd92538211ce service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:04.570209 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5237188-8aa1-4703-bdbe-cd92538211ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:04.578867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5237188-8aa1-4703-bdbe-cd92538211ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:04.580899 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5237188-8aa1-4703-bdbe-cd92538211ce service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:04.601498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1264/2532] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:10:04.840128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57d25-115b-4372-a48d-4f5dabdd9544 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:04.903619 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c57d25-115b-4372-a48d-4f5dabdd9544 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:04.908917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:04.911420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:04.911420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:04.911420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] PATH_INFO: `/v3/users/419aa51859404ffaa3c951195e084b6c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:04.911420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] RBAC: Authorizing `identity:delete_user(user_id=419aa51859404ffaa3c951195e084b6c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:04.914002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:05.095862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419aa51859404ffaa3c951195e084b6c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:05.108939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419aa51859404ffaa3c951195e084b6c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:05.109740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419aa51859404ffaa3c951195e084b6c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:05.110384 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419aa51859404ffaa3c951195e084b6c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:05.181526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419aa51859404ffaa3c951195e084b6c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:05.203694 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1269/2533] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:04 2022] DELETE /identity/v3/users/419aa51859404ffaa3c951195e084b6c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:05.207999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772766d-eebf-4de0-9afb-2ce170889efc None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:05.208467 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772766d-eebf-4de0-9afb-2ce170889efc None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:05.208823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772766d-eebf-4de0-9afb-2ce170889efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:05.231699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b772766d-eebf-4de0-9afb-2ce170889efc None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:05.233249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b772766d-eebf-4de0-9afb-2ce170889efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:05.351400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1265/2534] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:10:05.361656 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:05.363218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:05.453233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4711c9f-f3e8-4fca-b97d-667c6a4d441a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:05.460096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87ca8b-4d0b-4b44-98b5-843d4bdad4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:05.460733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ca8b-4d0b-4b44-98b5-843d4bdad4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:05.461004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ca8b-4d0b-4b44-98b5-843d4bdad4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:05.461275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87ca8b-4d0b-4b44-98b5-843d4bdad4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:05.468995 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:05.475214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87ca8b-4d0b-4b44-98b5-843d4bdad4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:05.476800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87ca8b-4d0b-4b44-98b5-843d4bdad4a9 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:05.488318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1270/2535] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:06.168909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772766d-eebf-4de0-9afb-2ce170889efc None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:06.171017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b772766d-eebf-4de0-9afb-2ce170889efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:06.193726 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772766d-eebf-4de0-9afb-2ce170889efc None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:06.202140 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:06.207134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:06.207134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:06.207134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] PATH_INFO: `/v3/projects/c4f4b259abc34581a41af18f5ae66bd8` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:06.207134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f4b259abc34581a41af18f5ae66bd8)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:06.209876 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:06.384742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f4b259abc34581a41af18f5ae66bd8', 'request_id': 'req-84465aa8-5f62-4d60-9c87-48a0f3d65605'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:06.393890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f4b259abc34581a41af18f5ae66bd8', 'request_id': 'req-84465aa8-5f62-4d60-9c87-48a0f3d65605'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:06.471985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f4b259abc34581a41af18f5ae66bd8', 'request_id': 'req-84465aa8-5f62-4d60-9c87-48a0f3d65605'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:06.494725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] The token cache is being invalidate because project c4f4b259abc34581a41af18f5ae66bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:06.495162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:06.496191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-84465aa8-5f62-4d60-9c87-48a0f3d65605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:06.502581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1266/2536] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:06 2022] DELETE /identity/v3/projects/c4f4b259abc34581a41af18f5ae66bd8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:06.507629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb64052-4ed4-45b2-9b11-ebf24ea0e717 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:06.508134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb64052-4ed4-45b2-9b11-ebf24ea0e717 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:06.508134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb64052-4ed4-45b2-9b11-ebf24ea0e717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:06.531139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2bb64052-4ed4-45b2-9b11-ebf24ea0e717 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:06.532351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2bb64052-4ed4-45b2-9b11-ebf24ea0e717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:06.605924 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1271/2537] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:06.615300 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd1ce-adbc-4ca5-9615-396eb81885d5 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:06.615577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd1ce-adbc-4ca5-9615-396eb81885d5 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:06.615844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd1ce-adbc-4ca5-9615-396eb81885d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:06.635728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-8a6cd1ce-adbc-4ca5-9615-396eb81885d5 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:06.637019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8a6cd1ce-adbc-4ca5-9615-396eb81885d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:06.644856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1267/2538] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:06.649284 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb64052-4ed4-45b2-9b11-ebf24ea0e717 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:06.658911 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb64052-4ed4-45b2-9b11-ebf24ea0e717 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:06.663441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce8bc2-5e43-4277-9ce7-1f419f00e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:06.664021 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8bc2-5e43-4277-9ce7-1f419f00e68c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:06.664292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8bc2-5e43-4277-9ce7-1f419f00e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:06.664559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8bc2-5e43-4277-9ce7-1f419f00e68c admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:06.665909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce8bc2-5e43-4277-9ce7-1f419f00e68c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:10:06.666205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce8bc2-5e43-4277-9ce7-1f419f00e68c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:06.667762 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce8bc2-5e43-4277-9ce7-1f419f00e68c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:06.679411 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1272/2539] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:10:06.684416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd1ce-adbc-4ca5-9615-396eb81885d5 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:06.694030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd1ce-adbc-4ca5-9615-396eb81885d5 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:06.698911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a4a37-db1d-4cae-968e-8ac6b2c626bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:06.699432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a4a37-db1d-4cae-968e-8ac6b2c626bd admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:06.699705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a4a37-db1d-4cae-968e-8ac6b2c626bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:06.699969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a4a37-db1d-4cae-968e-8ac6b2c626bd admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:06.700585 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a4a37-db1d-4cae-968e-8ac6b2c626bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:06.702625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a4a37-db1d-4cae-968e-8ac6b2c626bd admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:06.820201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1268/2540] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:06 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:06.824540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce8bc2-5e43-4277-9ce7-1f419f00e68c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:06.834790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce8bc2-5e43-4277-9ce7-1f419f00e68c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:06.892827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b562e-1103-439b-b997-2772742f7acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:06.893461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b562e-1103-439b-b997-2772742f7acf admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:06.893738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b562e-1103-439b-b997-2772742f7acf admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:06.894009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b562e-1103-439b-b997-2772742f7acf admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:06.894620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b562e-1103-439b-b997-2772742f7acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:06.896502 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b562e-1103-439b-b997-2772742f7acf admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:06.972509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1273/2541] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:06 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:06.976634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a4a37-db1d-4cae-968e-8ac6b2c626bd admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:06.990859 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a4a37-db1d-4cae-968e-8ac6b2c626bd admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:06.992907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8900b-88ed-460c-bd45-c57cb0cc3c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:06.993669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8900b-88ed-460c-bd45-c57cb0cc3c8f admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:06.993949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8900b-88ed-460c-bd45-c57cb0cc3c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:06.994214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8900b-88ed-460c-bd45-c57cb0cc3c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:06.994885 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8900b-88ed-460c-bd45-c57cb0cc3c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:06.996453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8900b-88ed-460c-bd45-c57cb0cc3c8f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:07.006594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1269/2542] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:10:07.010658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b562e-1103-439b-b997-2772742f7acf admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:07.025346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b562e-1103-439b-b997-2772742f7acf admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:07.029958 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3cc51-01d0-4297-b369-a04e4b15be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:07.030551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3cc51-01d0-4297-b369-a04e4b15be1c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:07.030822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3cc51-01d0-4297-b369-a04e4b15be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:07.031088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3cc51-01d0-4297-b369-a04e4b15be1c admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:07.031718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3cc51-01d0-4297-b369-a04e4b15be1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:07.033376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3cc51-01d0-4297-b369-a04e4b15be1c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:07.046746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1274/2543] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:07.050653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8900b-88ed-460c-bd45-c57cb0cc3c8f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:07.061730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8900b-88ed-460c-bd45-c57cb0cc3c8f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:07.066754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a3d82-fe40-4a34-a863-3cba8d420981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:07.067430 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3d82-fe40-4a34-a863-3cba8d420981 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:07.067710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3d82-fe40-4a34-a863-3cba8d420981 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:07.067979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a3d82-fe40-4a34-a863-3cba8d420981 admin admin] PATH_INFO: `/v3/projects/09641c2c2d6548a7ac588a5b4d37c4b6/users/674e6c26dbc84730bc2c57da0e8792af/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:07.085781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a3d82-fe40-4a34-a863-3cba8d420981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09641c2c2d6548a7ac588a5b4d37c4b6, user_id=674e6c26dbc84730bc2c57da0e8792af, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:07.089016 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a3d82-fe40-4a34-a863-3cba8d420981 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:07.178736 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1270/2544] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:07 2022] PUT /identity/v3/projects/09641c2c2d6548a7ac588a5b4d37c4b6/users/674e6c26dbc84730bc2c57da0e8792af/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:07.189823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d14a9e-068d-4020-847a-4c4fd16ff696 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:07.190198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d14a9e-068d-4020-847a-4c4fd16ff696 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:07.190378 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d14a9e-068d-4020-847a-4c4fd16ff696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:07.224414 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c5d14a9e-068d-4020-847a-4c4fd16ff696 None None] MFA Rules not processed for user `674e6c26dbc84730bc2c57da0e8792af`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:07.226106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c5d14a9e-068d-4020-847a-4c4fd16ff696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:07.280989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:07.301261 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1275/2545] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:07.305972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a3d82-fe40-4a34-a863-3cba8d420981 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:07.310770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:07.376229 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a3d82-fe40-4a34-a863-3cba8d420981 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:07.381599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8e8f8-f3ef-4f22-9287-786a8d61fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:07.386860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8e8f8-f3ef-4f22-9287-786a8d61fdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:07.386860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8e8f8-f3ef-4f22-9287-786a8d61fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:07.386860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8e8f8-f3ef-4f22-9287-786a8d61fdf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:07.386860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8e8f8-f3ef-4f22-9287-786a8d61fdf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:07.386860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8e8f8-f3ef-4f22-9287-786a8d61fdf9 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:07.505031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1271/2546] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:07 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:07.509844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d14a9e-068d-4020-847a-4c4fd16ff696 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:07.522716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d14a9e-068d-4020-847a-4c4fd16ff696 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:07.604491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0623c2-1da9-4500-8408-9820e64dfaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:07.605221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0623c2-1da9-4500-8408-9820e64dfaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:07.605621 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0623c2-1da9-4500-8408-9820e64dfaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:07.605990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0623c2-1da9-4500-8408-9820e64dfaf1 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:07.606722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0623c2-1da9-4500-8408-9820e64dfaf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:07.608746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0623c2-1da9-4500-8408-9820e64dfaf1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:07.769882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1276/2547] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:07 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:07.773763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8e8f8-f3ef-4f22-9287-786a8d61fdf9 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:07.793816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8e8f8-f3ef-4f22-9287-786a8d61fdf9 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:07.806142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564d1ed-8178-416c-a2d7-94c1849319cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:07.809143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564d1ed-8178-416c-a2d7-94c1849319cc admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:07.809706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564d1ed-8178-416c-a2d7-94c1849319cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:07.810797 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564d1ed-8178-416c-a2d7-94c1849319cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:07.813113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564d1ed-8178-416c-a2d7-94c1849319cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:07.817575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564d1ed-8178-416c-a2d7-94c1849319cc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:07.836453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1272/2548] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:07.841137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0623c2-1da9-4500-8408-9820e64dfaf1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:07.853562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0623c2-1da9-4500-8408-9820e64dfaf1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:07.861779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c66cd-6c85-45e7-b1f8-fc63b92405cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:07.862487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c66cd-6c85-45e7-b1f8-fc63b92405cf admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:07.862766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c66cd-6c85-45e7-b1f8-fc63b92405cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:07.863041 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c66cd-6c85-45e7-b1f8-fc63b92405cf admin admin] PATH_INFO: `/v3/projects/5c3076f604124fec8503d2d0aa66bfb6/users/ed46d3aaa76a4cb2a4e918629e1cd6a5/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:07.880511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c66cd-6c85-45e7-b1f8-fc63b92405cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3076f604124fec8503d2d0aa66bfb6, user_id=ed46d3aaa76a4cb2a4e918629e1cd6a5, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:07.883323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c66cd-6c85-45e7-b1f8-fc63b92405cf admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:07.996270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1277/2549] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:07 2022] PUT /identity/v3/projects/5c3076f604124fec8503d2d0aa66bfb6/users/ed46d3aaa76a4cb2a4e918629e1cd6a5/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:07.999888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564d1ed-8178-416c-a2d7-94c1849319cc admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:08.011830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564d1ed-8178-416c-a2d7-94c1849319cc admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:08.080811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdd347-38e5-49ae-9b25-ab1b875c6d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:08.081465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdd347-38e5-49ae-9b25-ab1b875c6d9a admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:08.081872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdd347-38e5-49ae-9b25-ab1b875c6d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:08.082147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdd347-38e5-49ae-9b25-ab1b875c6d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:08.083288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdd347-38e5-49ae-9b25-ab1b875c6d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:08.084878 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdd347-38e5-49ae-9b25-ab1b875c6d9a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:08.099774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1273/2550] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:08.101131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c66cd-6c85-45e7-b1f8-fc63b92405cf admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:08.114370 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c66cd-6c85-45e7-b1f8-fc63b92405cf admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:08.119994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2bcac-d718-454f-a823-e8d9717c3451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:08.120850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2bcac-d718-454f-a823-e8d9717c3451 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:08.121080 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2bcac-d718-454f-a823-e8d9717c3451 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:08.121554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2bcac-d718-454f-a823-e8d9717c3451 admin admin] PATH_INFO: `/v3/projects/5c3076f604124fec8503d2d0aa66bfb6/users/ed46d3aaa76a4cb2a4e918629e1cd6a5/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:08.123716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2bcac-d718-454f-a823-e8d9717c3451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3076f604124fec8503d2d0aa66bfb6, user_id=ed46d3aaa76a4cb2a4e918629e1cd6a5, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:08.126574 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2bcac-d718-454f-a823-e8d9717c3451 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:08.139728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1278/2551] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:08 2022] PUT /identity/v3/projects/5c3076f604124fec8503d2d0aa66bfb6/users/ed46d3aaa76a4cb2a4e918629e1cd6a5/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:08.150406 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6333-ef1b-4658-87bb-fc0bd4cba8a4 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:08.150691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6333-ef1b-4658-87bb-fc0bd4cba8a4 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:08.150962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d6333-ef1b-4658-87bb-fc0bd4cba8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:08.196492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-511d6333-ef1b-4658-87bb-fc0bd4cba8a4 None None] MFA Rules not processed for user `ed46d3aaa76a4cb2a4e918629e1cd6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:08.198002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-511d6333-ef1b-4658-87bb-fc0bd4cba8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:08.280757 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:08.285147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1274/2552] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:08.296160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2bcac-d718-454f-a823-e8d9717c3451 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:08.298096 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-add2bcac-d718-454f-a823-e8d9717c3451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:08.359336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2bcac-d718-454f-a823-e8d9717c3451 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:08.363307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a4d3f-5327-409c-b25e-4c9fb67402a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:08.363902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a4d3f-5327-409c-b25e-4c9fb67402a4 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:08.364176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a4d3f-5327-409c-b25e-4c9fb67402a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:08.364442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a4d3f-5327-409c-b25e-4c9fb67402a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:08.425573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:08.428060 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a4d3f-5327-409c-b25e-4c9fb67402a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:08.429681 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a4d3f-5327-409c-b25e-4c9fb67402a4 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:08.439587 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1279/2553] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:09.667740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e894-9aa3-4ccc-bf4a-e8922633ceb6 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:09.668223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e894-9aa3-4ccc-bf4a-e8922633ceb6 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:09.668520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50e894-9aa3-4ccc-bf4a-e8922633ceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:09.712566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-1c50e894-9aa3-4ccc-bf4a-e8922633ceb6 None None] MFA Rules not processed for user `e7957b745a2540a88f3c2fc042ac43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:09.713540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1c50e894-9aa3-4ccc-bf4a-e8922633ceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:09.804398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1275/2554] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:09.815495 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a4d3f-5327-409c-b25e-4c9fb67402a4 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:09.817092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e10a4d3f-5327-409c-b25e-4c9fb67402a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:09.885956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a4d3f-5327-409c-b25e-4c9fb67402a4 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:09.889647 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7929b-5923-4a58-9f3c-8c42377f0191 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e86be85010d4851a1ce3381832af230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:09.890391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7929b-5923-4a58-9f3c-8c42377f0191 service glance] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:09.890742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7929b-5923-4a58-9f3c-8c42377f0191 service glance] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:09.891013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7929b-5923-4a58-9f3c-8c42377f0191 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:09.892745 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a8f7929b-5923-4a58-9f3c-8c42377f0191 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:09.958369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7929b-5923-4a58-9f3c-8c42377f0191 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:09.959836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7929b-5923-4a58-9f3c-8c42377f0191 service glance] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:09.970040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1280/2555] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:10.222121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975be3e-63df-4126-8ad7-5f6ae2959320 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:10.222471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975be3e-63df-4126-8ad7-5f6ae2959320 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:10.222808 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975be3e-63df-4126-8ad7-5f6ae2959320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:10.242131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f975be3e-63df-4126-8ad7-5f6ae2959320 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:10.243916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f975be3e-63df-4126-8ad7-5f6ae2959320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:10.301724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1276/2556] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:10:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:10.323530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7929b-5923-4a58-9f3c-8c42377f0191 service glance] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:10.325048 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a8f7929b-5923-4a58-9f3c-8c42377f0191 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:10.404136 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7929b-5923-4a58-9f3c-8c42377f0191 service glance] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:10.409123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b937b-c58d-44f2-965c-3e05e9a0762f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:10.409790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b937b-c58d-44f2-965c-3e05e9a0762f service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:10.410114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b937b-c58d-44f2-965c-3e05e9a0762f service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:10.410332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b937b-c58d-44f2-965c-3e05e9a0762f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:10.419506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b937b-c58d-44f2-965c-3e05e9a0762f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:10.421097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b937b-c58d-44f2-965c-3e05e9a0762f service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:10.429386 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1281/2557] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:10:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:10:11.829485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975be3e-63df-4126-8ad7-5f6ae2959320 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:11.841793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975be3e-63df-4126-8ad7-5f6ae2959320 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:11.848512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9821d-e779-497d-b04a-913f7f2d717e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:11.849820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9821d-e779-497d-b04a-913f7f2d717e service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:11.850171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9821d-e779-497d-b04a-913f7f2d717e service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:11.850511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9821d-e779-497d-b04a-913f7f2d717e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:11.861432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9821d-e779-497d-b04a-913f7f2d717e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:11.863810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9821d-e779-497d-b04a-913f7f2d717e service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:11.875900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1277/2558] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:20.425988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=82 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:20.922310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b1d7d-7cfa-4a9d-9e79-bf605f8ab309 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:20.922592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b1d7d-7cfa-4a9d-9e79-bf605f8ab309 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:20.922941 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b1d7d-7cfa-4a9d-9e79-bf605f8ab309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:20.942436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cb7b1d7d-7cfa-4a9d-9e79-bf605f8ab309 None None] MFA Rules not processed for user `caac71d5134e4bacbc2dc28baf0c984d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:20.943626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cb7b1d7d-7cfa-4a9d-9e79-bf605f8ab309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:20.950451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1282/2559] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:21.870178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=66 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:24.347268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569e6b1-ab84-4cc8-b254-d560f4cdbf4b None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:24.347851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569e6b1-ab84-4cc8-b254-d560f4cdbf4b None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:24.347851 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569e6b1-ab84-4cc8-b254-d560f4cdbf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:24.367109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-3569e6b1-ab84-4cc8-b254-d560f4cdbf4b None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:24.368857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3569e6b1-ab84-4cc8-b254-d560f4cdbf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:24.376013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1278/2560] 10.222.0.77 () {58 vars in 1009 bytes} [Wed Aug 10 23:10:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:24.388488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b1d7d-7cfa-4a9d-9e79-bf605f8ab309 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:24.402154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b1d7d-7cfa-4a9d-9e79-bf605f8ab309 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:24.413773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37e89-c7a6-464f-a90f-576d99f5e879 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:24.413773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37e89-c7a6-464f-a90f-576d99f5e879 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:24.413773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37e89-c7a6-464f-a90f-576d99f5e879 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:24.413773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37e89-c7a6-464f-a90f-576d99f5e879 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:24.423598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d37e89-c7a6-464f-a90f-576d99f5e879 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:24.425214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d37e89-c7a6-464f-a90f-576d99f5e879 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:24.433731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1283/2561] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:10:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:10:26.624754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569e6b1-ab84-4cc8-b254-d560f4cdbf4b None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:26.626361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3569e6b1-ab84-4cc8-b254-d560f4cdbf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:26.686421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569e6b1-ab84-4cc8-b254-d560f4cdbf4b None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:26.690399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e1c90-0df0-4bf2-87d9-4aa47ac74e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:26.691078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1c90-0df0-4bf2-87d9-4aa47ac74e6f service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:26.691354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1c90-0df0-4bf2-87d9-4aa47ac74e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:26.691619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e1c90-0df0-4bf2-87d9-4aa47ac74e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:26.693665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-513e1c90-0df0-4bf2-87d9-4aa47ac74e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:26.778139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e1c90-0df0-4bf2-87d9-4aa47ac74e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:26.779563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e1c90-0df0-4bf2-87d9-4aa47ac74e6f service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:26.791151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1279/2562] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:28.681911 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37e89-c7a6-464f-a90f-576d99f5e879 service swift] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:28.762640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37e89-c7a6-464f-a90f-576d99f5e879 service swift] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:28.767204 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:28.767831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:28.768110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:28.768390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] PATH_INFO: `/v3/users/674e6c26dbc84730bc2c57da0e8792af` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:28.769544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=674e6c26dbc84730bc2c57da0e8792af)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:28.771470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:28.975638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674e6c26dbc84730bc2c57da0e8792af'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:28.993804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674e6c26dbc84730bc2c57da0e8792af'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:28.994534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674e6c26dbc84730bc2c57da0e8792af'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:28.995130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674e6c26dbc84730bc2c57da0e8792af'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:29.058268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674e6c26dbc84730bc2c57da0e8792af'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:29.074090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1284/2563] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:28 2022] DELETE /identity/v3/users/674e6c26dbc84730bc2c57da0e8792af => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:29.083965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71adab-ffc6-4d51-9cc6-df4ef09f103c None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:29.084515 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71adab-ffc6-4d51-9cc6-df4ef09f103c None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:29.084756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71adab-ffc6-4d51-9cc6-df4ef09f103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:29.110516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-5e71adab-ffc6-4d51-9cc6-df4ef09f103c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:29.111770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5e71adab-ffc6-4d51-9cc6-df4ef09f103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:29.177650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1280/2564] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:29.187533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:29.188915 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:29.265919 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666c89-cd3b-4ca0-9347-712e1bcd34e6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:29.270669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d2c48-c93a-484d-8239-22606f30995a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:29.271511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d2c48-c93a-484d-8239-22606f30995a service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:29.271965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d2c48-c93a-484d-8239-22606f30995a service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:29.272558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d2c48-c93a-484d-8239-22606f30995a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:29.283026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d2c48-c93a-484d-8239-22606f30995a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:29.284992 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d2c48-c93a-484d-8239-22606f30995a service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:29.296540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1285/2565] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:29.780889 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71adab-ffc6-4d51-9cc6-df4ef09f103c None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:29.782523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-5e71adab-ffc6-4d51-9cc6-df4ef09f103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:29.795460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71adab-ffc6-4d51-9cc6-df4ef09f103c None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:29.800747 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:29.801458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:29.801741 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:29.802068 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] PATH_INFO: `/v3/projects/09641c2c2d6548a7ac588a5b4d37c4b6` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:29.803155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=09641c2c2d6548a7ac588a5b4d37c4b6)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:29.805680 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:29.854101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d2c48-c93a-484d-8239-22606f30995a service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:29.858985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:29.864675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d2c48-c93a-484d-8239-22606f30995a service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:29.869211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684fbbe-42bf-4e4d-8d80-0347858dfe1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:29.873150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684fbbe-42bf-4e4d-8d80-0347858dfe1d service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:29.873150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684fbbe-42bf-4e4d-8d80-0347858dfe1d service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:29.873150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684fbbe-42bf-4e4d-8d80-0347858dfe1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:29.873150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e684fbbe-42bf-4e4d-8d80-0347858dfe1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:29.926131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:29.942084 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09641c2c2d6548a7ac588a5b4d37c4b6', 'request_id': 'req-c5f0f6c8-318f-400d-9417-9ada5b2320bc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:29.950814 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09641c2c2d6548a7ac588a5b4d37c4b6', 'request_id': 'req-c5f0f6c8-318f-400d-9417-9ada5b2320bc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:29.971718 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684fbbe-42bf-4e4d-8d80-0347858dfe1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:29.973738 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684fbbe-42bf-4e4d-8d80-0347858dfe1d service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:29.987433 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1286/2566] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:10:30.057903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09641c2c2d6548a7ac588a5b4d37c4b6', 'request_id': 'req-c5f0f6c8-318f-400d-9417-9ada5b2320bc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:30.070025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] The token cache is being invalidate because project 09641c2c2d6548a7ac588a5b4d37c4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:30.070386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:30.072638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:30.074269 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1281/2567] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:29 2022] DELETE /identity/v3/projects/09641c2c2d6548a7ac588a5b4d37c4b6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:30.078224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684fbbe-42bf-4e4d-8d80-0347858dfe1d service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:30.091175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684fbbe-42bf-4e4d-8d80-0347858dfe1d service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:30.155750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:30.156410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:30.156684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:30.156953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] PATH_INFO: `/v3/users/ed46d3aaa76a4cb2a4e918629e1cd6a5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:30.158174 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed46d3aaa76a4cb2a4e918629e1cd6a5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:30.160113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:30.337116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed46d3aaa76a4cb2a4e918629e1cd6a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:30.353428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed46d3aaa76a4cb2a4e918629e1cd6a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:30.354179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed46d3aaa76a4cb2a4e918629e1cd6a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:30.355127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed46d3aaa76a4cb2a4e918629e1cd6a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:30.441312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8d8c859b-e9fc-4e8c-9a3e-7b7a0263ceab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed46d3aaa76a4cb2a4e918629e1cd6a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:30.465480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1287/2568] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:30 2022] DELETE /identity/v3/users/ed46d3aaa76a4cb2a4e918629e1cd6a5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:30.906099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:30.908179 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:30.931047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0f6c8-318f-400d-9417-9ada5b2320bc admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:30.993908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:30.994823 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:30.995106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:30.995381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] PATH_INFO: `/v3/projects/5c3076f604124fec8503d2d0aa66bfb6` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:30.996607 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3076f604124fec8503d2d0aa66bfb6)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:30.998567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:31.113309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3076f604124fec8503d2d0aa66bfb6', 'request_id': 'req-9730ae5e-20cb-40ce-8cbd-8c89190a412e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:31.121594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3076f604124fec8503d2d0aa66bfb6', 'request_id': 'req-9730ae5e-20cb-40ce-8cbd-8c89190a412e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:31.218511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3076f604124fec8503d2d0aa66bfb6', 'request_id': 'req-9730ae5e-20cb-40ce-8cbd-8c89190a412e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:31.238582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] The token cache is being invalidate because project 5c3076f604124fec8503d2d0aa66bfb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:31.239112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:31.240243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-9730ae5e-20cb-40ce-8cbd-8c89190a412e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:31.243365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1282/2569] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:30 2022] DELETE /identity/v3/projects/5c3076f604124fec8503d2d0aa66bfb6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:31.248862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7044e5-657a-4b6f-9e7e-dac61b32616c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:31.249477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7044e5-657a-4b6f-9e7e-dac61b32616c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:31.249477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7044e5-657a-4b6f-9e7e-dac61b32616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:31.280359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:31.286881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-aa7044e5-657a-4b6f-9e7e-dac61b32616c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:31.288091 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aa7044e5-657a-4b6f-9e7e-dac61b32616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:31.349968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1288/2570] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:31.359114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8bd3-3201-4203-84ee-5e6ae63c4670 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:31.359479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8bd3-3201-4203-84ee-5e6ae63c4670 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:31.359786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8bd3-3201-4203-84ee-5e6ae63c4670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:31.380976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-011f8bd3-3201-4203-84ee-5e6ae63c4670 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:31.382382 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-011f8bd3-3201-4203-84ee-5e6ae63c4670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:31.392894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1283/2571] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:31.397277 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7044e5-657a-4b6f-9e7e-dac61b32616c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:31.409527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7044e5-657a-4b6f-9e7e-dac61b32616c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:31.415850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0a075-77bf-4081-b3f7-f84ea5264aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:31.416547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0a075-77bf-4081-b3f7-f84ea5264aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:31.416895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0a075-77bf-4081-b3f7-f84ea5264aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:31.417237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0a075-77bf-4081-b3f7-f84ea5264aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:31.417988 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0a075-77bf-4081-b3f7-f84ea5264aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:10:31.418359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0a075-77bf-4081-b3f7-f84ea5264aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:31.420058 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0a075-77bf-4081-b3f7-f84ea5264aa9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:31.437423 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1289/2572] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:10:31.439224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8bd3-3201-4203-84ee-5e6ae63c4670 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:31.449514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8bd3-3201-4203-84ee-5e6ae63c4670 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:31.454415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12177ebc-3180-4e81-a37a-44b6457c83bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:31.455019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12177ebc-3180-4e81-a37a-44b6457c83bd admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:31.455292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12177ebc-3180-4e81-a37a-44b6457c83bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:31.455557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12177ebc-3180-4e81-a37a-44b6457c83bd admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:31.456171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12177ebc-3180-4e81-a37a-44b6457c83bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:31.458112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12177ebc-3180-4e81-a37a-44b6457c83bd admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:31.581786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1284/2573] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:31 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:31.586019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0a075-77bf-4081-b3f7-f84ea5264aa9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:31.596747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0a075-77bf-4081-b3f7-f84ea5264aa9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:31.687044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf8fb9-af91-4521-92f4-d978c5393991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:31.688399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf8fb9-af91-4521-92f4-d978c5393991 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:31.689061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf8fb9-af91-4521-92f4-d978c5393991 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:31.689580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf8fb9-af91-4521-92f4-d978c5393991 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:31.690532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf8fb9-af91-4521-92f4-d978c5393991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:31.692832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf8fb9-af91-4521-92f4-d978c5393991 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:31.771094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1290/2574] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:31 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:31.775920 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12177ebc-3180-4e81-a37a-44b6457c83bd admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:31.786581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12177ebc-3180-4e81-a37a-44b6457c83bd admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:31.792121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba75280-0b0d-4485-8c44-68b5fc27266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:31.792786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba75280-0b0d-4485-8c44-68b5fc27266e admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:31.793186 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba75280-0b0d-4485-8c44-68b5fc27266e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:31.793546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba75280-0b0d-4485-8c44-68b5fc27266e admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:31.794485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba75280-0b0d-4485-8c44-68b5fc27266e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:31.796376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba75280-0b0d-4485-8c44-68b5fc27266e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:31.802978 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:31.808612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1285/2575] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:31.812690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf8fb9-af91-4521-92f4-d978c5393991 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:31.823377 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf8fb9-af91-4521-92f4-d978c5393991 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:31.828493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb8baf-9e40-43e1-bd18-91da6acf7dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:31.829332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8baf-9e40-43e1-bd18-91da6acf7dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:31.829620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8baf-9e40-43e1-bd18-91da6acf7dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:31.829890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8baf-9e40-43e1-bd18-91da6acf7dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:31.830564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb8baf-9e40-43e1-bd18-91da6acf7dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:31.832197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb8baf-9e40-43e1-bd18-91da6acf7dd7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:31.849506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1291/2576] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:31.850681 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba75280-0b0d-4485-8c44-68b5fc27266e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:31.863125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba75280-0b0d-4485-8c44-68b5fc27266e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:31.868561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187ba3a-6cc2-4d80-9e07-6aa14d7ee204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:31.869218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187ba3a-6cc2-4d80-9e07-6aa14d7ee204 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:31.869523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187ba3a-6cc2-4d80-9e07-6aa14d7ee204 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:31.869860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187ba3a-6cc2-4d80-9e07-6aa14d7ee204 admin admin] PATH_INFO: `/v3/projects/c2616f0136764e8da5808bc160512961/users/218f9853cbcc4f66a3bffe5c1d4e4d3e/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:31.885567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187ba3a-6cc2-4d80-9e07-6aa14d7ee204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2616f0136764e8da5808bc160512961, user_id=218f9853cbcc4f66a3bffe5c1d4e4d3e, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:31.888606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187ba3a-6cc2-4d80-9e07-6aa14d7ee204 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:31.966742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1286/2577] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:31 2022] PUT /identity/v3/projects/c2616f0136764e8da5808bc160512961/users/218f9853cbcc4f66a3bffe5c1d4e4d3e/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:31.978112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a9737-703e-4b7c-bfd3-03b55b8db747 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:31.978550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a9737-703e-4b7c-bfd3-03b55b8db747 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:31.978671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a9737-703e-4b7c-bfd3-03b55b8db747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:32.009702 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-593a9737-703e-4b7c-bfd3-03b55b8db747 None None] MFA Rules not processed for user `218f9853cbcc4f66a3bffe5c1d4e4d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:32.011143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-593a9737-703e-4b7c-bfd3-03b55b8db747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:32.084626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1292/2578] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:10:32.089168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187ba3a-6cc2-4d80-9e07-6aa14d7ee204 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:32.167609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187ba3a-6cc2-4d80-9e07-6aa14d7ee204 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:32.172571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8f868-8ac5-47ba-983d-3e34759eccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:32.173315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8f868-8ac5-47ba-983d-3e34759eccc9 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:32.173640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8f868-8ac5-47ba-983d-3e34759eccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:32.173984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8f868-8ac5-47ba-983d-3e34759eccc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:32.174684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8f868-8ac5-47ba-983d-3e34759eccc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:32.176655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8f868-8ac5-47ba-983d-3e34759eccc9 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:32.628409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1287/2579] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:32 2022] POST /identity/v3/projects => generated 369 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:32.631530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a9737-703e-4b7c-bfd3-03b55b8db747 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:32.637475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:32.644687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a9737-703e-4b7c-bfd3-03b55b8db747 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:32.709188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f79b3-ea4d-442e-ac36-6250e2928cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:32.709831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f79b3-ea4d-442e-ac36-6250e2928cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:32.710108 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f79b3-ea4d-442e-ac36-6250e2928cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:32.710396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f79b3-ea4d-442e-ac36-6250e2928cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:32.710985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f79b3-ea4d-442e-ac36-6250e2928cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:32.712892 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f79b3-ea4d-442e-ac36-6250e2928cb8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:32.802359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1293/2580] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:32 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:32.806652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8f868-8ac5-47ba-983d-3e34759eccc9 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:32.819136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8f868-8ac5-47ba-983d-3e34759eccc9 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:32.824637 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efab997-e97f-45c8-85af-2e310e9a3ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:32.825644 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efab997-e97f-45c8-85af-2e310e9a3ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:32.826088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efab997-e97f-45c8-85af-2e310e9a3ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:32.826484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efab997-e97f-45c8-85af-2e310e9a3ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:32.827335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efab997-e97f-45c8-85af-2e310e9a3ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:32.829271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efab997-e97f-45c8-85af-2e310e9a3ce8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:32.841274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1288/2581] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:32.846470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f79b3-ea4d-442e-ac36-6250e2928cb8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:32.861710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f79b3-ea4d-442e-ac36-6250e2928cb8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:32.869191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712582e7-4237-4b35-af70-00975ca34730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:32.869894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712582e7-4237-4b35-af70-00975ca34730 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:32.870230 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712582e7-4237-4b35-af70-00975ca34730 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:32.870621 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712582e7-4237-4b35-af70-00975ca34730 admin admin] PATH_INFO: `/v3/projects/27a9eaf8a6fd4d39b5ab2b73f7c2ae5d/users/0c30ade24e3f4b3f9decd2ca7917738a/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:32.899158 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712582e7-4237-4b35-af70-00975ca34730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a9eaf8a6fd4d39b5ab2b73f7c2ae5d, user_id=0c30ade24e3f4b3f9decd2ca7917738a, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:32.902481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712582e7-4237-4b35-af70-00975ca34730 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:32.996434 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1294/2582] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:32 2022] PUT /identity/v3/projects/27a9eaf8a6fd4d39b5ab2b73f7c2ae5d/users/0c30ade24e3f4b3f9decd2ca7917738a/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:33.001589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efab997-e97f-45c8-85af-2e310e9a3ce8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:33.016137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efab997-e97f-45c8-85af-2e310e9a3ce8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:33.076019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80256bd-3897-4300-b767-036acd48cf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:33.076628 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80256bd-3897-4300-b767-036acd48cf8a admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:33.076905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80256bd-3897-4300-b767-036acd48cf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:33.077176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80256bd-3897-4300-b767-036acd48cf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:33.077845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80256bd-3897-4300-b767-036acd48cf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:33.079418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80256bd-3897-4300-b767-036acd48cf8a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:33.092925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1289/2583] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:33.101550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712582e7-4237-4b35-af70-00975ca34730 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:33.113230 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712582e7-4237-4b35-af70-00975ca34730 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:33.119013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63820cc8-2496-4d00-8a8f-bf9624f61ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:33.119670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820cc8-2496-4d00-8a8f-bf9624f61ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:33.119951 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820cc8-2496-4d00-8a8f-bf9624f61ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:33.120225 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820cc8-2496-4d00-8a8f-bf9624f61ffb admin admin] PATH_INFO: `/v3/projects/27a9eaf8a6fd4d39b5ab2b73f7c2ae5d/users/0c30ade24e3f4b3f9decd2ca7917738a/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:33.122187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63820cc8-2496-4d00-8a8f-bf9624f61ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a9eaf8a6fd4d39b5ab2b73f7c2ae5d, user_id=0c30ade24e3f4b3f9decd2ca7917738a, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:33.124811 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63820cc8-2496-4d00-8a8f-bf9624f61ffb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:33.135027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1295/2584] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:33 2022] PUT /identity/v3/projects/27a9eaf8a6fd4d39b5ab2b73f7c2ae5d/users/0c30ade24e3f4b3f9decd2ca7917738a/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:33.146906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2398dd-ffe5-4107-b3d3-6a10df869a20 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:33.147292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2398dd-ffe5-4107-b3d3-6a10df869a20 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:33.147632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2398dd-ffe5-4107-b3d3-6a10df869a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:33.176348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-da2398dd-ffe5-4107-b3d3-6a10df869a20 None None] MFA Rules not processed for user `0c30ade24e3f4b3f9decd2ca7917738a`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:33.179707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-da2398dd-ffe5-4107-b3d3-6a10df869a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:33.210687 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:33.246127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1290/2585] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:33.257413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63820cc8-2496-4d00-8a8f-bf9624f61ffb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:33.259094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-63820cc8-2496-4d00-8a8f-bf9624f61ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:33.316773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63820cc8-2496-4d00-8a8f-bf9624f61ffb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:33.320333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791df94-12ed-467b-bc28-0d952a5d135c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:33.321470 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791df94-12ed-467b-bc28-0d952a5d135c service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:33.321746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791df94-12ed-467b-bc28-0d952a5d135c service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:33.328725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791df94-12ed-467b-bc28-0d952a5d135c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:33.330921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791df94-12ed-467b-bc28-0d952a5d135c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:33.332439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791df94-12ed-467b-bc28-0d952a5d135c service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:33.342240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1296/2586] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:33.455759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2398dd-ffe5-4107-b3d3-6a10df869a20 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:33.457161 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-da2398dd-ffe5-4107-b3d3-6a10df869a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:33.468824 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2398dd-ffe5-4107-b3d3-6a10df869a20 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:33.472714 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67475fa9-0a3d-4322-b4ad-e5ec1d1cd348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:33.473306 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67475fa9-0a3d-4322-b4ad-e5ec1d1cd348 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:33.473594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67475fa9-0a3d-4322-b4ad-e5ec1d1cd348 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:33.473865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67475fa9-0a3d-4322-b4ad-e5ec1d1cd348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:33.530322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67475fa9-0a3d-4322-b4ad-e5ec1d1cd348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:33.531751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67475fa9-0a3d-4322-b4ad-e5ec1d1cd348 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:33.541386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1291/2587] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:39.172283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791df94-12ed-467b-bc28-0d952a5d135c service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:39.229516 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:39.233611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791df94-12ed-467b-bc28-0d952a5d135c service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:39.238272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:39.238896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:39.239175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:39.239447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] PATH_INFO: `/v3/users/218f9853cbcc4f66a3bffe5c1d4e4d3e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:39.240564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218f9853cbcc4f66a3bffe5c1d4e4d3e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:39.242706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:39.462003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218f9853cbcc4f66a3bffe5c1d4e4d3e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:39.476724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218f9853cbcc4f66a3bffe5c1d4e4d3e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:39.477467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218f9853cbcc4f66a3bffe5c1d4e4d3e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:39.478070 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218f9853cbcc4f66a3bffe5c1d4e4d3e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:39.552510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218f9853cbcc4f66a3bffe5c1d4e4d3e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:39.575894 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1297/2588] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:39 2022] DELETE /identity/v3/users/218f9853cbcc4f66a3bffe5c1d4e4d3e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:39.577976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3c9df-aa61-4ec1-a1e2-40df7d8e5847 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:39.579086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3c9df-aa61-4ec1-a1e2-40df7d8e5847 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:39.579717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3c9df-aa61-4ec1-a1e2-40df7d8e5847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:39.607973 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-1ae3c9df-aa61-4ec1-a1e2-40df7d8e5847 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:39.609655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1ae3c9df-aa61-4ec1-a1e2-40df7d8e5847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:39.683157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1292/2589] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:10:39.693934 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:39.695475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:39.762556 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af262601-ddac-44c4-aedb-8704f08cded4 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:39.767399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955df6-3e24-4529-86f2-c901757e9894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:39.768165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955df6-3e24-4529-86f2-c901757e9894 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:39.768438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955df6-3e24-4529-86f2-c901757e9894 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:39.768704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955df6-3e24-4529-86f2-c901757e9894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:39.779356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42955df6-3e24-4529-86f2-c901757e9894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:39.780661 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42955df6-3e24-4529-86f2-c901757e9894 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:39.791450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1298/2590] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:40.270892 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3c9df-aa61-4ec1-a1e2-40df7d8e5847 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:40.272850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1ae3c9df-aa61-4ec1-a1e2-40df7d8e5847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:40.292255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3c9df-aa61-4ec1-a1e2-40df7d8e5847 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:40.297784 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:40.298462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:40.298796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:40.298942 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] PATH_INFO: `/v3/projects/c2616f0136764e8da5808bc160512961` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:40.300401 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2616f0136764e8da5808bc160512961)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:40.302381 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:40.402066 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2616f0136764e8da5808bc160512961', 'request_id': 'req-43164ee1-93c6-44f7-8516-280169f724a6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:40.408653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2616f0136764e8da5808bc160512961', 'request_id': 'req-43164ee1-93c6-44f7-8516-280169f724a6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:40.491974 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2616f0136764e8da5808bc160512961', 'request_id': 'req-43164ee1-93c6-44f7-8516-280169f724a6'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:40.496365 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:40.503162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] The token cache is being invalidate because project c2616f0136764e8da5808bc160512961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:40.503446 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:40.504071 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:40.505834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1293/2591] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:40 2022] DELETE /identity/v3/projects/c2616f0136764e8da5808bc160512961 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:40.509799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955df6-3e24-4529-86f2-c901757e9894 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:40.519736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955df6-3e24-4529-86f2-c901757e9894 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:40.584273 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:40.584930 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:40.585205 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:40.585510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] PATH_INFO: `/v3/users/0c30ade24e3f4b3f9decd2ca7917738a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:40.587276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c30ade24e3f4b3f9decd2ca7917738a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:40.589211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:40.612474 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:40.817838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c30ade24e3f4b3f9decd2ca7917738a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:40.829941 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c30ade24e3f4b3f9decd2ca7917738a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:40.830598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c30ade24e3f4b3f9decd2ca7917738a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:40.831206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c30ade24e3f4b3f9decd2ca7917738a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:40.905676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5a0ae34c-003c-4a3d-9fa8-e532e4c405b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c30ade24e3f4b3f9decd2ca7917738a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:40.918501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1299/2592] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:40 2022] DELETE /identity/v3/users/0c30ade24e3f4b3f9decd2ca7917738a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:41.311312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:41.312812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:41.326167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43164ee1-93c6-44f7-8516-280169f724a6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:41.385424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:41.386042 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:41.386314 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:41.386578 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] PATH_INFO: `/v3/projects/27a9eaf8a6fd4d39b5ab2b73f7c2ae5d` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:41.387720 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a9eaf8a6fd4d39b5ab2b73f7c2ae5d)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:41.389636 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:41.485810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a9eaf8a6fd4d39b5ab2b73f7c2ae5d', 'request_id': 'req-b3cc1e54-3caf-4f0a-b5db-fa510640032d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:41.491794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a9eaf8a6fd4d39b5ab2b73f7c2ae5d', 'request_id': 'req-b3cc1e54-3caf-4f0a-b5db-fa510640032d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:41.559620 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a9eaf8a6fd4d39b5ab2b73f7c2ae5d', 'request_id': 'req-b3cc1e54-3caf-4f0a-b5db-fa510640032d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:41.572626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] The token cache is being invalidate because project 27a9eaf8a6fd4d39b5ab2b73f7c2ae5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:41.574595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:41.574595 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b3cc1e54-3caf-4f0a-b5db-fa510640032d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:41.575040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1294/2593] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:41 2022] DELETE /identity/v3/projects/27a9eaf8a6fd4d39b5ab2b73f7c2ae5d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:41.580177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddedaf1-2a33-4d39-ae5d-6cab9bfdcf57 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:41.580680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddedaf1-2a33-4d39-ae5d-6cab9bfdcf57 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:41.580790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddedaf1-2a33-4d39-ae5d-6cab9bfdcf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:41.602558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1ddedaf1-2a33-4d39-ae5d-6cab9bfdcf57 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:41.603736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1ddedaf1-2a33-4d39-ae5d-6cab9bfdcf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:41.666366 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1300/2594] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:41.674213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0a33c-3436-496b-aeaf-c6320b6c0054 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:41.674561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0a33c-3436-496b-aeaf-c6320b6c0054 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:41.674896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0a33c-3436-496b-aeaf-c6320b6c0054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:41.694669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-36d0a33c-3436-496b-aeaf-c6320b6c0054 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:41.695869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-36d0a33c-3436-496b-aeaf-c6320b6c0054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:41.703486 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1295/2595] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:41.707695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddedaf1-2a33-4d39-ae5d-6cab9bfdcf57 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:41.717553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddedaf1-2a33-4d39-ae5d-6cab9bfdcf57 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:41.722450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232be7f-7889-4ba0-a514-3aebf0dde926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:41.723035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232be7f-7889-4ba0-a514-3aebf0dde926 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:41.727278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232be7f-7889-4ba0-a514-3aebf0dde926 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:41.727278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232be7f-7889-4ba0-a514-3aebf0dde926 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:41.727278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232be7f-7889-4ba0-a514-3aebf0dde926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:10:41.727278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232be7f-7889-4ba0-a514-3aebf0dde926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:41.727278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232be7f-7889-4ba0-a514-3aebf0dde926 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:41.738128 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1301/2596] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:10:41.743115 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0a33c-3436-496b-aeaf-c6320b6c0054 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:41.752197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0a33c-3436-496b-aeaf-c6320b6c0054 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:41.756778 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ab820-57f2-4066-b1b2-911052ee0572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:41.757385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab820-57f2-4066-b1b2-911052ee0572 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:41.757657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab820-57f2-4066-b1b2-911052ee0572 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:41.757948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab820-57f2-4066-b1b2-911052ee0572 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:41.758557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ab820-57f2-4066-b1b2-911052ee0572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:41.760407 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ab820-57f2-4066-b1b2-911052ee0572 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:41.844674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1296/2597] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:41 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:41.848362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232be7f-7889-4ba0-a514-3aebf0dde926 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:41.859691 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232be7f-7889-4ba0-a514-3aebf0dde926 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:41.920220 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903ae59-8da8-4b01-83b1-eac238bd1324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:41.920821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903ae59-8da8-4b01-83b1-eac238bd1324 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:41.921092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903ae59-8da8-4b01-83b1-eac238bd1324 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:41.921413 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903ae59-8da8-4b01-83b1-eac238bd1324 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:41.922001 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903ae59-8da8-4b01-83b1-eac238bd1324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:41.923881 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903ae59-8da8-4b01-83b1-eac238bd1324 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:42.035035 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1302/2598] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:41 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:42.039939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ab820-57f2-4066-b1b2-911052ee0572 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:42.050102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ab820-57f2-4066-b1b2-911052ee0572 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:42.054631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49c78a-dca8-4c3e-b2e5-67705ab6b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:42.055245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49c78a-dca8-4c3e-b2e5-67705ab6b376 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.055505 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49c78a-dca8-4c3e-b2e5-67705ab6b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.055775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49c78a-dca8-4c3e-b2e5-67705ab6b376 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:42.056409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49c78a-dca8-4c3e-b2e5-67705ab6b376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:42.058021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49c78a-dca8-4c3e-b2e5-67705ab6b376 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:42.067841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1297/2599] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:42.072175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903ae59-8da8-4b01-83b1-eac238bd1324 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:42.082281 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903ae59-8da8-4b01-83b1-eac238bd1324 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:42.087392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949a47e-b311-4480-8206-949fa520ba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:42.087983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949a47e-b311-4480-8206-949fa520ba1d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.088258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949a47e-b311-4480-8206-949fa520ba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.088525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949a47e-b311-4480-8206-949fa520ba1d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:42.089159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949a47e-b311-4480-8206-949fa520ba1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:42.090780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949a47e-b311-4480-8206-949fa520ba1d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:42.102469 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1303/2600] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:42.106460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49c78a-dca8-4c3e-b2e5-67705ab6b376 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:42.116199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49c78a-dca8-4c3e-b2e5-67705ab6b376 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:42.120707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22e828-7891-4209-b61d-8c8852a06dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:42.121367 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22e828-7891-4209-b61d-8c8852a06dba admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.121635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22e828-7891-4209-b61d-8c8852a06dba admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.121908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22e828-7891-4209-b61d-8c8852a06dba admin admin] PATH_INFO: `/v3/projects/20678a30c90445a68b803bcee4ce0701/users/146512cef13740708f1c3d26b436b471/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:42.139677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22e828-7891-4209-b61d-8c8852a06dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=20678a30c90445a68b803bcee4ce0701, user_id=146512cef13740708f1c3d26b436b471, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:42.142706 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22e828-7891-4209-b61d-8c8852a06dba admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:42.206513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1298/2601] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:42 2022] PUT /identity/v3/projects/20678a30c90445a68b803bcee4ce0701/users/146512cef13740708f1c3d26b436b471/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:42.217399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186342a-2d3f-43e2-b283-a8e68d66e33d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.217684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186342a-2d3f-43e2-b283-a8e68d66e33d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.217956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186342a-2d3f-43e2-b283-a8e68d66e33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:42.226610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:42.247995 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6186342a-2d3f-43e2-b283-a8e68d66e33d None None] MFA Rules not processed for user `146512cef13740708f1c3d26b436b471`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:42.249150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6186342a-2d3f-43e2-b283-a8e68d66e33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:42.318781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1304/2602] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:42.324282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22e828-7891-4209-b61d-8c8852a06dba admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:42.349591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:42.389251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22e828-7891-4209-b61d-8c8852a06dba admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:42.393999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4643-4c51-4ae9-b0f9-ea2433b59a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:42.394596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4643-4c51-4ae9-b0f9-ea2433b59a6c admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.394877 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4643-4c51-4ae9-b0f9-ea2433b59a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.395147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4643-4c51-4ae9-b0f9-ea2433b59a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:42.395752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf4643-4c51-4ae9-b0f9-ea2433b59a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:42.397751 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf4643-4c51-4ae9-b0f9-ea2433b59a6c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:42.502767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1299/2603] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:42 2022] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:42.506772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186342a-2d3f-43e2-b283-a8e68d66e33d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:42.517975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186342a-2d3f-43e2-b283-a8e68d66e33d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:42.577669 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6721c-c4b3-4c25-839d-df08e35f48a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:42.578264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6721c-c4b3-4c25-839d-df08e35f48a5 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.578536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6721c-c4b3-4c25-839d-df08e35f48a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.578803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6721c-c4b3-4c25-839d-df08e35f48a5 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:42.579406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6721c-c4b3-4c25-839d-df08e35f48a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:42.581364 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6721c-c4b3-4c25-839d-df08e35f48a5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:42.682009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1305/2604] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:42 2022] POST /identity/v3/users => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:42.685774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4643-4c51-4ae9-b0f9-ea2433b59a6c admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:42.696556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4643-4c51-4ae9-b0f9-ea2433b59a6c admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:42.702007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45ec44-f99a-4ade-bee1-fd94a190a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:42.708866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ec44-f99a-4ade-bee1-fd94a190a9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.708866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ec44-f99a-4ade-bee1-fd94a190a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.708866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ec44-f99a-4ade-bee1-fd94a190a9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:42.708866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45ec44-f99a-4ade-bee1-fd94a190a9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:42.708866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45ec44-f99a-4ade-bee1-fd94a190a9a2 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:42.715631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1300/2605] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:42.719825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6721c-c4b3-4c25-839d-df08e35f48a5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:42.730171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6721c-c4b3-4c25-839d-df08e35f48a5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:42.735005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebac646-b038-4082-b853-d776011d2ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:42.735651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac646-b038-4082-b853-d776011d2ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.735956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac646-b038-4082-b853-d776011d2ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.736228 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac646-b038-4082-b853-d776011d2ee6 admin admin] PATH_INFO: `/v3/projects/5faf0fab586c4970b93dadb9eece0349/users/a8d3b40fc00148c3b84239fc1e6d906c/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:42.752519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebac646-b038-4082-b853-d776011d2ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faf0fab586c4970b93dadb9eece0349, user_id=a8d3b40fc00148c3b84239fc1e6d906c, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:42.755234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebac646-b038-4082-b853-d776011d2ee6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:42.844528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1306/2606] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:42 2022] PUT /identity/v3/projects/5faf0fab586c4970b93dadb9eece0349/users/a8d3b40fc00148c3b84239fc1e6d906c/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:42.848798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45ec44-f99a-4ade-bee1-fd94a190a9a2 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:42.860087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45ec44-f99a-4ade-bee1-fd94a190a9a2 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:42.916787 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935113b-e9c8-48f1-8278-69273bcce7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:42.917442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935113b-e9c8-48f1-8278-69273bcce7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.917725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935113b-e9c8-48f1-8278-69273bcce7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.917999 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935113b-e9c8-48f1-8278-69273bcce7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:42.918626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935113b-e9c8-48f1-8278-69273bcce7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:42.920213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935113b-e9c8-48f1-8278-69273bcce7f8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:42.930191 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1301/2607] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:42.934461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebac646-b038-4082-b853-d776011d2ee6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:42.944725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebac646-b038-4082-b853-d776011d2ee6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:42.949609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c9f0d-219e-4339-9bba-b086daa20159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:42.950252 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c9f0d-219e-4339-9bba-b086daa20159 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.950594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c9f0d-219e-4339-9bba-b086daa20159 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.950952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c9f0d-219e-4339-9bba-b086daa20159 admin admin] PATH_INFO: `/v3/projects/5faf0fab586c4970b93dadb9eece0349/users/a8d3b40fc00148c3b84239fc1e6d906c/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:42.952809 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c9f0d-219e-4339-9bba-b086daa20159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faf0fab586c4970b93dadb9eece0349, user_id=a8d3b40fc00148c3b84239fc1e6d906c, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:42.955450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c9f0d-219e-4339-9bba-b086daa20159 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:42.966041 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1307/2608] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:42 2022] PUT /identity/v3/projects/5faf0fab586c4970b93dadb9eece0349/users/a8d3b40fc00148c3b84239fc1e6d906c/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:42.978011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6f019-3563-4689-920f-be789c150ecd None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:42.978307 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6f019-3563-4689-920f-be789c150ecd None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:42.978575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6f019-3563-4689-920f-be789c150ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:43.006801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-35a6f019-3563-4689-920f-be789c150ecd None None] MFA Rules not processed for user `a8d3b40fc00148c3b84239fc1e6d906c`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:43.007980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-35a6f019-3563-4689-920f-be789c150ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:43.077432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1302/2609] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:43.088921 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c9f0d-219e-4339-9bba-b086daa20159 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:43.090647 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-638c9f0d-219e-4339-9bba-b086daa20159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:43.151491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:43.156448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c9f0d-219e-4339-9bba-b086daa20159 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:43.160183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2faa5-5e0d-489b-8ffc-730ac86b5ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:43.160780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2faa5-5e0d-489b-8ffc-730ac86b5ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:43.161055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2faa5-5e0d-489b-8ffc-730ac86b5ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:43.161441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2faa5-5e0d-489b-8ffc-730ac86b5ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:43.171341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2faa5-5e0d-489b-8ffc-730ac86b5ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:43.172754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2faa5-5e0d-489b-8ffc-730ac86b5ed9 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:43.182153 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1308/2610] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:43.314564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6f019-3563-4689-920f-be789c150ecd None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:43.331705 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:43.376002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6f019-3563-4689-920f-be789c150ecd None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:43.380503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:43.381120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:43.381421 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:43.381690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] PATH_INFO: `/v3/users/146512cef13740708f1c3d26b436b471` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:43.382790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=146512cef13740708f1c3d26b436b471)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:43.385320 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:43.588671 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146512cef13740708f1c3d26b436b471'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:43.596056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146512cef13740708f1c3d26b436b471'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:43.608750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146512cef13740708f1c3d26b436b471'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:43.609545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146512cef13740708f1c3d26b436b471'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:43.610155 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146512cef13740708f1c3d26b436b471'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:43.694547 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1303/2611] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:43 2022] DELETE /identity/v3/users/146512cef13740708f1c3d26b436b471 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:43.699724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd3d4-319a-4368-ae24-7ba80b0c3782 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:43.700208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd3d4-319a-4368-ae24-7ba80b0c3782 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:43.700325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bd3d4-319a-4368-ae24-7ba80b0c3782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:43.719586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-200bd3d4-319a-4368-ae24-7ba80b0c3782 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:43.721279 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-200bd3d4-319a-4368-ae24-7ba80b0c3782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:43.792671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1309/2612] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:43.802434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:43.804094 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:43.869257 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafeda3-6d85-4e24-ac1a-fde90ea671c1 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:43.872926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4be40c-29d8-4506-b7ea-68c2099b9bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:43.873645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4be40c-29d8-4506-b7ea-68c2099b9bbe service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:43.873918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4be40c-29d8-4506-b7ea-68c2099b9bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:43.874185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4be40c-29d8-4506-b7ea-68c2099b9bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:43.885095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4be40c-29d8-4506-b7ea-68c2099b9bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:43.886733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4be40c-29d8-4506-b7ea-68c2099b9bbe service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:43.897271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1304/2613] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:10:44.450848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd3d4-319a-4368-ae24-7ba80b0c3782 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:44.452543 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-200bd3d4-319a-4368-ae24-7ba80b0c3782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:44.466379 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bd3d4-319a-4368-ae24-7ba80b0c3782 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:44.471404 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:44.472134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:44.472501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:44.472839 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] PATH_INFO: `/v3/projects/20678a30c90445a68b803bcee4ce0701` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:44.474091 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20678a30c90445a68b803bcee4ce0701)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:44.476206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:44.601615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20678a30c90445a68b803bcee4ce0701', 'request_id': 'req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:44.608551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20678a30c90445a68b803bcee4ce0701', 'request_id': 'req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:44.718253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20678a30c90445a68b803bcee4ce0701', 'request_id': 'req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:44.729540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] The token cache is being invalidate because project 20678a30c90445a68b803bcee4ce0701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:44.729829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:44.730452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:44.731991 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1310/2614] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:44 2022] DELETE /identity/v3/projects/20678a30c90445a68b803bcee4ce0701 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:44.735937 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4be40c-29d8-4506-b7ea-68c2099b9bbe service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:44.745905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4be40c-29d8-4506-b7ea-68c2099b9bbe service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:44.779752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:44.801657 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:44.802246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:44.802522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:44.802786 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] PATH_INFO: `/v3/users/a8d3b40fc00148c3b84239fc1e6d906c` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:44.803872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d3b40fc00148c3b84239fc1e6d906c)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:44.805798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:45.033114 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d3b40fc00148c3b84239fc1e6d906c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:45.039676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d3b40fc00148c3b84239fc1e6d906c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:45.051576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d3b40fc00148c3b84239fc1e6d906c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:45.053272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d3b40fc00148c3b84239fc1e6d906c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:45.053272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8bf39401-4601-420a-943d-690a820621e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d3b40fc00148c3b84239fc1e6d906c'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:45.135604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1305/2615] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:44 2022] DELETE /identity/v3/users/a8d3b40fc00148c3b84239fc1e6d906c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:45.536362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:45.537804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:45.557152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5fc0b-6cec-48fc-9605-f3b78ef3f94d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:45.612773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:45.613340 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:45.613618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:45.613884 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] PATH_INFO: `/v3/projects/5faf0fab586c4970b93dadb9eece0349` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:45.614967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5faf0fab586c4970b93dadb9eece0349)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:45.616904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:45.632747 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:45.730497 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5faf0fab586c4970b93dadb9eece0349', 'request_id': 'req-bc574178-2870-493b-aacc-b90e2bd7dc43'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:45.739245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5faf0fab586c4970b93dadb9eece0349', 'request_id': 'req-bc574178-2870-493b-aacc-b90e2bd7dc43'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:45.849269 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5faf0fab586c4970b93dadb9eece0349', 'request_id': 'req-bc574178-2870-493b-aacc-b90e2bd7dc43'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:45.863429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] The token cache is being invalidate because project 5faf0fab586c4970b93dadb9eece0349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:45.863723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:45.864398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bc574178-2870-493b-aacc-b90e2bd7dc43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:45.867846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1311/2616] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:45 2022] DELETE /identity/v3/projects/5faf0fab586c4970b93dadb9eece0349 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:45.872785 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1266d1-0c22-4b9c-88c0-67ad606001ef None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:45.873269 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1266d1-0c22-4b9c-88c0-67ad606001ef None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:45.873408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1266d1-0c22-4b9c-88c0-67ad606001ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:45.892575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9d1266d1-0c22-4b9c-88c0-67ad606001ef None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:45.893811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9d1266d1-0c22-4b9c-88c0-67ad606001ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:45.954198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1306/2617] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:45.962763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a7491-940f-4be9-baa3-0eb9df095dcf None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:45.963054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a7491-940f-4be9-baa3-0eb9df095dcf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:45.963331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a7491-940f-4be9-baa3-0eb9df095dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:45.985327 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4f7a7491-940f-4be9-baa3-0eb9df095dcf None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:45.986609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4f7a7491-940f-4be9-baa3-0eb9df095dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:45.996294 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1312/2618] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:46.000734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1266d1-0c22-4b9c-88c0-67ad606001ef None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:46.013058 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1266d1-0c22-4b9c-88c0-67ad606001ef None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:46.016309 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4df846-c4d3-47a1-9459-7e6c771c5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:46.016928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4df846-c4d3-47a1-9459-7e6c771c5466 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:46.017200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4df846-c4d3-47a1-9459-7e6c771c5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:46.017500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4df846-c4d3-47a1-9459-7e6c771c5466 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:46.018131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4df846-c4d3-47a1-9459-7e6c771c5466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:10:46.018523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4df846-c4d3-47a1-9459-7e6c771c5466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:46.025336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4df846-c4d3-47a1-9459-7e6c771c5466 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:46.047490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1307/2619] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:10:46.048650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a7491-940f-4be9-baa3-0eb9df095dcf None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:46.057875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a7491-940f-4be9-baa3-0eb9df095dcf None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:46.062902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18fd92-54be-4983-92fb-628f664eb412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:46.063581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fd92-54be-4983-92fb-628f664eb412 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:46.063929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fd92-54be-4983-92fb-628f664eb412 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:46.064271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fd92-54be-4983-92fb-628f664eb412 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:46.065144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18fd92-54be-4983-92fb-628f664eb412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:46.067103 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18fd92-54be-4983-92fb-628f664eb412 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:46.157912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1313/2620] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:46 2022] POST /identity/v3/projects => generated 407 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:46.159025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4df846-c4d3-47a1-9459-7e6c771c5466 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:46.169081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4df846-c4d3-47a1-9459-7e6c771c5466 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:46.212525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:46.228659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b21f3-bef1-4180-b0a8-4387d4c7862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:46.229285 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b21f3-bef1-4180-b0a8-4387d4c7862e admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:46.229590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b21f3-bef1-4180-b0a8-4387d4c7862e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:46.229863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b21f3-bef1-4180-b0a8-4387d4c7862e admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:46.230485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b21f3-bef1-4180-b0a8-4387d4c7862e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:46.232411 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b21f3-bef1-4180-b0a8-4387d4c7862e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:46.345103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1308/2621] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:46 2022] POST /identity/v3/users => generated 304 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:46.349485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18fd92-54be-4983-92fb-628f664eb412 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:46.360223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18fd92-54be-4983-92fb-628f664eb412 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:46.365026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fee049-9d23-4d29-986a-7bb876fada73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:46.365610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fee049-9d23-4d29-986a-7bb876fada73 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:46.365850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fee049-9d23-4d29-986a-7bb876fada73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:46.366121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fee049-9d23-4d29-986a-7bb876fada73 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:46.366756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fee049-9d23-4d29-986a-7bb876fada73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:46.368345 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fee049-9d23-4d29-986a-7bb876fada73 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:46.378286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1314/2622] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:46.382212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b21f3-bef1-4180-b0a8-4387d4c7862e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:46.392742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b21f3-bef1-4180-b0a8-4387d4c7862e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:46.397310 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c23b7a-0152-4651-9288-8ae0d729ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:46.400303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23b7a-0152-4651-9288-8ae0d729ebca admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:46.400303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23b7a-0152-4651-9288-8ae0d729ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:46.400303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23b7a-0152-4651-9288-8ae0d729ebca admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:46.400303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c23b7a-0152-4651-9288-8ae0d729ebca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:46.401143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c23b7a-0152-4651-9288-8ae0d729ebca admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:46.411831 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1309/2623] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:46.416256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fee049-9d23-4d29-986a-7bb876fada73 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:46.426325 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fee049-9d23-4d29-986a-7bb876fada73 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:46.432572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986ee65-9669-4917-814d-d2fb57d8cbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:46.433271 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986ee65-9669-4917-814d-d2fb57d8cbd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:46.433578 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986ee65-9669-4917-814d-d2fb57d8cbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:46.433852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986ee65-9669-4917-814d-d2fb57d8cbd2 admin admin] PATH_INFO: `/v3/projects/07729c97fa77485b997f2cceecc1493c/users/b3217a7566b04f0b9ef01dc15ce06807/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:46.450542 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986ee65-9669-4917-814d-d2fb57d8cbd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07729c97fa77485b997f2cceecc1493c, user_id=b3217a7566b04f0b9ef01dc15ce06807, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:46.453321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986ee65-9669-4917-814d-d2fb57d8cbd2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:46.535667 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1315/2624] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:46 2022] PUT /identity/v3/projects/07729c97fa77485b997f2cceecc1493c/users/b3217a7566b04f0b9ef01dc15ce06807/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:46.547089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9875d5f-f4d1-40cc-ad37-fba72984d078 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:46.547375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9875d5f-f4d1-40cc-ad37-fba72984d078 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:46.547647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9875d5f-f4d1-40cc-ad37-fba72984d078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:46.580372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b9875d5f-f4d1-40cc-ad37-fba72984d078 None None] MFA Rules not processed for user `b3217a7566b04f0b9ef01dc15ce06807`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:46.581616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b9875d5f-f4d1-40cc-ad37-fba72984d078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:46.650221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1310/2625] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:46.654797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986ee65-9669-4917-814d-d2fb57d8cbd2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:46.719081 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986ee65-9669-4917-814d-d2fb57d8cbd2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:46.723954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89b1d-203c-4165-88b6-d59753aa6da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:46.724546 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89b1d-203c-4165-88b6-d59753aa6da1 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:46.724821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89b1d-203c-4165-88b6-d59753aa6da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:46.725101 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89b1d-203c-4165-88b6-d59753aa6da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:46.725775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e89b1d-203c-4165-88b6-d59753aa6da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:46.727730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e89b1d-203c-4165-88b6-d59753aa6da1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:46.833255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1316/2626] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:46 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:46.837374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9875d5f-f4d1-40cc-ad37-fba72984d078 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:46.848288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9875d5f-f4d1-40cc-ad37-fba72984d078 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:46.904285 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abc036-aae1-4fe7-9dba-23737840d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:46.904954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc036-aae1-4fe7-9dba-23737840d98e admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:46.905055 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc036-aae1-4fe7-9dba-23737840d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:46.905356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abc036-aae1-4fe7-9dba-23737840d98e admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:46.906004 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abc036-aae1-4fe7-9dba-23737840d98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:46.908021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abc036-aae1-4fe7-9dba-23737840d98e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:46.980570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1311/2627] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:46 2022] POST /identity/v3/users => generated 311 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:46.984575 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89b1d-203c-4165-88b6-d59753aa6da1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:46.995664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89b1d-203c-4165-88b6-d59753aa6da1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:47.000324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11a215-4029-4fcf-8897-9791970073df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:47.000912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11a215-4029-4fcf-8897-9791970073df admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:47.001188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11a215-4029-4fcf-8897-9791970073df admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:47.001498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11a215-4029-4fcf-8897-9791970073df admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:47.002127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11a215-4029-4fcf-8897-9791970073df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:47.003700 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11a215-4029-4fcf-8897-9791970073df admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:47.014135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1317/2628] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:47.018171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abc036-aae1-4fe7-9dba-23737840d98e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:47.027925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abc036-aae1-4fe7-9dba-23737840d98e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:47.032469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfe33b-902c-48fa-b37d-58a181d3d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:47.033105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfe33b-902c-48fa-b37d-58a181d3d814 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:47.033411 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfe33b-902c-48fa-b37d-58a181d3d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:47.033680 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfe33b-902c-48fa-b37d-58a181d3d814 admin admin] PATH_INFO: `/v3/projects/a62a407c39884c79b81227d882c01426/users/94990c183ec64200bbfc3a26257350a1/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:47.048753 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfe33b-902c-48fa-b37d-58a181d3d814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62a407c39884c79b81227d882c01426, user_id=94990c183ec64200bbfc3a26257350a1, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:47.051385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfe33b-902c-48fa-b37d-58a181d3d814 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:47.131072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1312/2629] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:47 2022] PUT /identity/v3/projects/a62a407c39884c79b81227d882c01426/users/94990c183ec64200bbfc3a26257350a1/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:47.133801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11a215-4029-4fcf-8897-9791970073df admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:47.138063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfe33b-902c-48fa-b37d-58a181d3d814 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:47.141587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-23bfe33b-902c-48fa-b37d-58a181d3d814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:47.143993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11a215-4029-4fcf-8897-9791970073df admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:47.152980 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:47.161131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:47.198580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfe33b-902c-48fa-b37d-58a181d3d814 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:47.199369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bebd9-3b26-4db1-8e7c-b7b3c535cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:47.199970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bebd9-3b26-4db1-8e7c-b7b3c535cd3d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:47.200243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bebd9-3b26-4db1-8e7c-b7b3c535cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:47.200512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bebd9-3b26-4db1-8e7c-b7b3c535cd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:47.201139 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bebd9-3b26-4db1-8e7c-b7b3c535cd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:47.202725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cfe17-9255-4eb3-beb6-da9488163afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:47.202885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bebd9-3b26-4db1-8e7c-b7b3c535cd3d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:47.203451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cfe17-9255-4eb3-beb6-da9488163afd service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:47.203790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cfe17-9255-4eb3-beb6-da9488163afd service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:47.204118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cfe17-9255-4eb3-beb6-da9488163afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:47.205910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3e6cfe17-9255-4eb3-beb6-da9488163afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:47.213100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1318/2630] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:47.217321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bebd9-3b26-4db1-8e7c-b7b3c535cd3d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:47.218634 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cfe17-9255-4eb3-beb6-da9488163afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:47.220160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cfe17-9255-4eb3-beb6-da9488163afd service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:47.228955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bebd9-3b26-4db1-8e7c-b7b3c535cd3d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:47.231011 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1313/2631] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:10:47.233698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ca476-59da-40f8-ac8d-a20d6855687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:47.234363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ca476-59da-40f8-ac8d-a20d6855687a admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:47.234635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ca476-59da-40f8-ac8d-a20d6855687a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:47.234902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ca476-59da-40f8-ac8d-a20d6855687a admin admin] PATH_INFO: `/v3/projects/a62a407c39884c79b81227d882c01426/users/94990c183ec64200bbfc3a26257350a1/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:47.236967 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ca476-59da-40f8-ac8d-a20d6855687a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62a407c39884c79b81227d882c01426, user_id=94990c183ec64200bbfc3a26257350a1, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:47.239652 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ca476-59da-40f8-ac8d-a20d6855687a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:47.249992 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1319/2632] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:47 2022] PUT /identity/v3/projects/a62a407c39884c79b81227d882c01426/users/94990c183ec64200bbfc3a26257350a1/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:10:47.260461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcd6d5-5981-4538-8df2-75365085b229 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:47.260738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcd6d5-5981-4538-8df2-75365085b229 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:47.262312 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcd6d5-5981-4538-8df2-75365085b229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:47.290366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-edbcd6d5-5981-4538-8df2-75365085b229 None None] MFA Rules not processed for user `94990c183ec64200bbfc3a26257350a1`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:47.291677 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-edbcd6d5-5981-4538-8df2-75365085b229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:47.360024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1314/2633] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:47 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:47.371241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ca476-59da-40f8-ac8d-a20d6855687a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:47.372918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3c9ca476-59da-40f8-ac8d-a20d6855687a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:47.430915 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ca476-59da-40f8-ac8d-a20d6855687a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:47.434868 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13b483-7671-41dc-b1d6-86ab32701999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:47.435480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b483-7671-41dc-b1d6-86ab32701999 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:47.435760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b483-7671-41dc-b1d6-86ab32701999 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:47.436028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13b483-7671-41dc-b1d6-86ab32701999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:47.444979 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13b483-7671-41dc-b1d6-86ab32701999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:47.446449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13b483-7671-41dc-b1d6-86ab32701999 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:47.455942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1320/2634] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:47 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:47.813654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcd6d5-5981-4538-8df2-75365085b229 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:47.823717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcd6d5-5981-4538-8df2-75365085b229 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:47.827619 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52ae71-400e-43f6-bbad-a5ea40d1d460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:47.828460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ae71-400e-43f6-bbad-a5ea40d1d460 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:47.828624 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ae71-400e-43f6-bbad-a5ea40d1d460 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:47.828891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ae71-400e-43f6-bbad-a5ea40d1d460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:47.895744 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52ae71-400e-43f6-bbad-a5ea40d1d460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:47.897181 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52ae71-400e-43f6-bbad-a5ea40d1d460 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:47.907090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1315/2635] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:47 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:51.367377 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13b483-7671-41dc-b1d6-86ab32701999 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:51.368862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9b13b483-7671-41dc-b1d6-86ab32701999 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:51.436307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13b483-7671-41dc-b1d6-86ab32701999 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:51.440907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:51.441565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:51.441844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:51.442118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] PATH_INFO: `/v3/users/5f8353e92dc54d08ae0a82381d6d619d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:51.457699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8353e92dc54d08ae0a82381d6d619d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:51.459665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:51.697701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:51.715362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8353e92dc54d08ae0a82381d6d619d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:51.728312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8353e92dc54d08ae0a82381d6d619d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:51.729033 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8353e92dc54d08ae0a82381d6d619d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:51.729752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8353e92dc54d08ae0a82381d6d619d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:51.843451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-880d04a2-b8ff-467c-a9c2-93d3e17d288b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8353e92dc54d08ae0a82381d6d619d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:51.860089 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1321/2636] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:51 2022] DELETE /identity/v3/users/5f8353e92dc54d08ae0a82381d6d619d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:52.136850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52ae71-400e-43f6-bbad-a5ea40d1d460 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:52.148073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52ae71-400e-43f6-bbad-a5ea40d1d460 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:52.191438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:52.205569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:52.206189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:52.206465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:52.206733 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] PATH_INFO: `/v3/projects/7a6aab5394214e2fa112576a28598f68` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:52.219732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6aab5394214e2fa112576a28598f68)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:52.219732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:52.372916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6aab5394214e2fa112576a28598f68', 'request_id': 'req-d505c3b7-02e5-4d64-bafd-a74e19a80955'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:52.379596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6aab5394214e2fa112576a28598f68', 'request_id': 'req-d505c3b7-02e5-4d64-bafd-a74e19a80955'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:52.451954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6aab5394214e2fa112576a28598f68', 'request_id': 'req-d505c3b7-02e5-4d64-bafd-a74e19a80955'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:52.463149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] The token cache is being invalidate because project 7a6aab5394214e2fa112576a28598f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:52.463437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:52.464142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d505c3b7-02e5-4d64-bafd-a74e19a80955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:52.465638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1316/2637] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:52 2022] DELETE /identity/v3/projects/7a6aab5394214e2fa112576a28598f68 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:52.470547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ace3e9-854a-4c5e-a652-e5866a8d6aea None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:52.478597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ace3e9-854a-4c5e-a652-e5866a8d6aea None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:52.478597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ace3e9-854a-4c5e-a652-e5866a8d6aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:52.616507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-91ace3e9-854a-4c5e-a652-e5866a8d6aea None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:52.617768 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-91ace3e9-854a-4c5e-a652-e5866a8d6aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:52.675882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1322/2638] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:10:52.684250 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c0dd8-919e-44ba-803f-79e1dafb13e5 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:52.684531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c0dd8-919e-44ba-803f-79e1dafb13e5 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:52.684827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c0dd8-919e-44ba-803f-79e1dafb13e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:52.704058 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-f69c0dd8-919e-44ba-803f-79e1dafb13e5 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:52.705268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f69c0dd8-919e-44ba-803f-79e1dafb13e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:52.713742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1317/2639] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:52.718028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ace3e9-854a-4c5e-a652-e5866a8d6aea None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:52.728790 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ace3e9-854a-4c5e-a652-e5866a8d6aea None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:52.733408 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7129750-6231-42c9-bcb5-a7aa2799edbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:52.734000 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7129750-6231-42c9-bcb5-a7aa2799edbd admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:52.734279 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7129750-6231-42c9-bcb5-a7aa2799edbd admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:52.734547 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7129750-6231-42c9-bcb5-a7aa2799edbd admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:52.735185 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7129750-6231-42c9-bcb5-a7aa2799edbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:10:52.735482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7129750-6231-42c9-bcb5-a7aa2799edbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:52.737075 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7129750-6231-42c9-bcb5-a7aa2799edbd admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:52.749381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1323/2640] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:10:52.760037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c0dd8-919e-44ba-803f-79e1dafb13e5 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:52.769313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c0dd8-919e-44ba-803f-79e1dafb13e5 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:52.774569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a2d84-31c2-41e5-879a-13d70133df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:52.775153 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2d84-31c2-41e5-879a-13d70133df41 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:52.775424 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2d84-31c2-41e5-879a-13d70133df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:52.775690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2d84-31c2-41e5-879a-13d70133df41 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:52.776303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a2d84-31c2-41e5-879a-13d70133df41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:52.778223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a2d84-31c2-41e5-879a-13d70133df41 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:52.911072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1318/2641] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:52 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:52.915576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7129750-6231-42c9-bcb5-a7aa2799edbd admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:52.925840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7129750-6231-42c9-bcb5-a7aa2799edbd admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:52.985075 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9c63c-0de1-4848-9e52-ce5c81eb6900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:52.985633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9c63c-0de1-4848-9e52-ce5c81eb6900 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:52.985901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9c63c-0de1-4848-9e52-ce5c81eb6900 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:52.986198 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9c63c-0de1-4848-9e52-ce5c81eb6900 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:52.986804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9c63c-0de1-4848-9e52-ce5c81eb6900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:52.988748 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9c63c-0de1-4848-9e52-ce5c81eb6900 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:53.067693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1324/2642] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:52 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:53.072506 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a2d84-31c2-41e5-879a-13d70133df41 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:53.082979 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a2d84-31c2-41e5-879a-13d70133df41 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:53.088856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08325491-b6d3-49a8-a2da-085e8bc160c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:53.089543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325491-b6d3-49a8-a2da-085e8bc160c3 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:53.089899 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325491-b6d3-49a8-a2da-085e8bc160c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:53.090164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325491-b6d3-49a8-a2da-085e8bc160c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:53.090846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08325491-b6d3-49a8-a2da-085e8bc160c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:53.092405 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08325491-b6d3-49a8-a2da-085e8bc160c3 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:53.103242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1319/2643] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:53.107238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9c63c-0de1-4848-9e52-ce5c81eb6900 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:53.117238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9c63c-0de1-4848-9e52-ce5c81eb6900 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:53.121833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db7af6-ab75-4f74-999e-1dc6efa5fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:53.125524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db7af6-ab75-4f74-999e-1dc6efa5fadb admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:53.125524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db7af6-ab75-4f74-999e-1dc6efa5fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:53.125524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db7af6-ab75-4f74-999e-1dc6efa5fadb admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:53.125524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db7af6-ab75-4f74-999e-1dc6efa5fadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:53.125524 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db7af6-ab75-4f74-999e-1dc6efa5fadb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:53.135846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1325/2644] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:53.140339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08325491-b6d3-49a8-a2da-085e8bc160c3 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:53.152480 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08325491-b6d3-49a8-a2da-085e8bc160c3 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:53.157508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd223b-2158-4cfb-9fb6-ced3982192b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:53.158158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd223b-2158-4cfb-9fb6-ced3982192b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:53.158434 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd223b-2158-4cfb-9fb6-ced3982192b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:53.158704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd223b-2158-4cfb-9fb6-ced3982192b8 admin admin] PATH_INFO: `/v3/projects/d58221f7a7344b28af2d9a7ce314c746/users/4813ef4e03d44a9691baf4752f4a3fd7/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:53.173118 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd223b-2158-4cfb-9fb6-ced3982192b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58221f7a7344b28af2d9a7ce314c746, user_id=4813ef4e03d44a9691baf4752f4a3fd7, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:53.175872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd223b-2158-4cfb-9fb6-ced3982192b8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:53.278946 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1320/2645] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:53 2022] PUT /identity/v3/projects/d58221f7a7344b28af2d9a7ce314c746/users/4813ef4e03d44a9691baf4752f4a3fd7/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:53.294795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14454ad9-a1e2-40c7-aa04-6c1d6a3d9679 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:53.294795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14454ad9-a1e2-40c7-aa04-6c1d6a3d9679 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:53.294795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14454ad9-a1e2-40c7-aa04-6c1d6a3d9679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:53.316760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:53.319717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-14454ad9-a1e2-40c7-aa04-6c1d6a3d9679 None None] MFA Rules not processed for user `4813ef4e03d44a9691baf4752f4a3fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:53.321603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-14454ad9-a1e2-40c7-aa04-6c1d6a3d9679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:53.382624 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1326/2646] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:10:53.394697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd223b-2158-4cfb-9fb6-ced3982192b8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:53.396440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6acd223b-2158-4cfb-9fb6-ced3982192b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:53.454460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:53.469866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd223b-2158-4cfb-9fb6-ced3982192b8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:53.475667 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733bc95-676a-42d2-a702-cf0cf90b8058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:53.476263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733bc95-676a-42d2-a702-cf0cf90b8058 service nova] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:53.476575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733bc95-676a-42d2-a702-cf0cf90b8058 service nova] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:53.476835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733bc95-676a-42d2-a702-cf0cf90b8058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:53.484240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733bc95-676a-42d2-a702-cf0cf90b8058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:53.485868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733bc95-676a-42d2-a702-cf0cf90b8058 service nova] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:53.494971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1321/2647] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:10:55.128402 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14454ad9-a1e2-40c7-aa04-6c1d6a3d9679 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:55.129913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-14454ad9-a1e2-40c7-aa04-6c1d6a3d9679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:55.200403 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14454ad9-a1e2-40c7-aa04-6c1d6a3d9679 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:55.205114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:55.205764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:55.206036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:55.206302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] PATH_INFO: `/v3/users/b3217a7566b04f0b9ef01dc15ce06807` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:55.207550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3217a7566b04f0b9ef01dc15ce06807)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:55.209467 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:55.261522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733bc95-676a-42d2-a702-cf0cf90b8058 service nova] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:55.262925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-0733bc95-676a-42d2-a702-cf0cf90b8058 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:55.321026 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733bc95-676a-42d2-a702-cf0cf90b8058 service nova] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:55.324668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e6a2c-29ab-4550-b0c9-2809efef45ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:55.325261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e6a2c-29ab-4550-b0c9-2809efef45ea service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:55.325564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e6a2c-29ab-4550-b0c9-2809efef45ea service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:55.325835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e6a2c-29ab-4550-b0c9-2809efef45ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:55.327596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-642e6a2c-29ab-4550-b0c9-2809efef45ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:55.381950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3217a7566b04f0b9ef01dc15ce06807'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:55.395819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e6a2c-29ab-4550-b0c9-2809efef45ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:55.397420 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e6a2c-29ab-4550-b0c9-2809efef45ea service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:55.397594 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3217a7566b04f0b9ef01dc15ce06807'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:55.398331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3217a7566b04f0b9ef01dc15ce06807'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:55.399480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3217a7566b04f0b9ef01dc15ce06807'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:55.408610 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1322/2648] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:10:55.463597 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3217a7566b04f0b9ef01dc15ce06807'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:55.481841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1327/2649] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:55 2022] DELETE /identity/v3/users/b3217a7566b04f0b9ef01dc15ce06807 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:55.487051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673e15-25a8-4014-a31e-75fa5325fb6a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:55.487354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673e15-25a8-4014-a31e-75fa5325fb6a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:55.487647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673e15-25a8-4014-a31e-75fa5325fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:55.512676 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-a0673e15-25a8-4014-a31e-75fa5325fb6a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:55.513928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a0673e15-25a8-4014-a31e-75fa5325fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:55.575750 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1323/2650] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:55.585650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:55.587152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:55.613775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:55.646140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707c667-0ab1-4a9c-ace0-44bcc1f26336 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:55.651684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e69a7-8d25-40bb-be63-60da345c5f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:55.652293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e69a7-8d25-40bb-be63-60da345c5f8b service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:55.652572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e69a7-8d25-40bb-be63-60da345c5f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:55.652844 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e69a7-8d25-40bb-be63-60da345c5f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:55.662235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e69a7-8d25-40bb-be63-60da345c5f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:55.663660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e69a7-8d25-40bb-be63-60da345c5f8b service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:55.673316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1328/2651] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:56.154335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673e15-25a8-4014-a31e-75fa5325fb6a None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:56.155925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a0673e15-25a8-4014-a31e-75fa5325fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:56.169675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673e15-25a8-4014-a31e-75fa5325fb6a None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:56.174862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:56.175691 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:56.176069 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:56.176440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] PATH_INFO: `/v3/projects/07729c97fa77485b997f2cceecc1493c` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:56.177758 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=07729c97fa77485b997f2cceecc1493c)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:56.180460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:56.278557 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:56.291849 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07729c97fa77485b997f2cceecc1493c', 'request_id': 'req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:56.298138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07729c97fa77485b997f2cceecc1493c', 'request_id': 'req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:56.398032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07729c97fa77485b997f2cceecc1493c', 'request_id': 'req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:56.409802 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] The token cache is being invalidate because project 07729c97fa77485b997f2cceecc1493c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:56.410092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:56.410735 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:56.412251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1324/2652] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:56 2022] DELETE /identity/v3/projects/07729c97fa77485b997f2cceecc1493c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:56.416711 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e69a7-8d25-40bb-be63-60da345c5f8b service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:56.426504 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e69a7-8d25-40bb-be63-60da345c5f8b service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:56.482564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:56.483182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:56.483484 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:56.483780 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] PATH_INFO: `/v3/users/94990c183ec64200bbfc3a26257350a1` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:56.484960 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94990c183ec64200bbfc3a26257350a1)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:56.486904 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:56.652612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94990c183ec64200bbfc3a26257350a1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:56.665103 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94990c183ec64200bbfc3a26257350a1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:56.665902 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94990c183ec64200bbfc3a26257350a1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:56.666605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94990c183ec64200bbfc3a26257350a1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:56.768997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf484e32-8756-4a44-b061-c2ebb21cc6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94990c183ec64200bbfc3a26257350a1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:56.782416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1329/2653] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:56 2022] DELETE /identity/v3/users/94990c183ec64200bbfc3a26257350a1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:56.896398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:56.896398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:56.913332 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e694a-c9b8-4f47-a87a-cf2681cde5ab admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:56.973109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:56.973738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:56.974282 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:56.974403 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] PATH_INFO: `/v3/users/4813ef4e03d44a9691baf4752f4a3fd7` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:56.975644 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4813ef4e03d44a9691baf4752f4a3fd7)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:56.977895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:57.163201 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4813ef4e03d44a9691baf4752f4a3fd7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:57.170520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4813ef4e03d44a9691baf4752f4a3fd7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:57.185031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4813ef4e03d44a9691baf4752f4a3fd7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:57.201193 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4813ef4e03d44a9691baf4752f4a3fd7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:57.204865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4813ef4e03d44a9691baf4752f4a3fd7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:57.294106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1325/2654] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:10:56 2022] DELETE /identity/v3/users/4813ef4e03d44a9691baf4752f4a3fd7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:57.298891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffdf57-3a9e-4fff-a550-c797b56a2814 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:57.299255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffdf57-3a9e-4fff-a550-c797b56a2814 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:57.299526 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffdf57-3a9e-4fff-a550-c797b56a2814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:57.319017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-22ffdf57-3a9e-4fff-a550-c797b56a2814 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:57.320197 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-22ffdf57-3a9e-4fff-a550-c797b56a2814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:57.362123 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:57.380722 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1330/2655] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:57.390599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:57.392189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:57.403873 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffdf57-3a9e-4fff-a550-c797b56a2814 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:57.406189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-22ffdf57-3a9e-4fff-a550-c797b56a2814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:57.422996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffdf57-3a9e-4fff-a550-c797b56a2814 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:57.431312 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:57.432440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:57.432871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:57.433317 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] PATH_INFO: `/v3/projects/a62a407c39884c79b81227d882c01426` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:57.434753 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62a407c39884c79b81227d882c01426)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:57.436895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:57.455443 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:57.472025 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126037ba-6953-4d13-ae30-6fc71b8cba6e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:57.475959 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6c856-7944-48b1-88cc-203bab6bf76d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:57.477098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6c856-7944-48b1-88cc-203bab6bf76d service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:57.477565 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6c856-7944-48b1-88cc-203bab6bf76d service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:57.477833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6c856-7944-48b1-88cc-203bab6bf76d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:57.490841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6c856-7944-48b1-88cc-203bab6bf76d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:57.493040 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6c856-7944-48b1-88cc-203bab6bf76d service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:57.505418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1326/2656] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:10:57.559093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62a407c39884c79b81227d882c01426', 'request_id': 'req-65a41e64-5284-42ff-9d66-9b153eddc912'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:57.567586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62a407c39884c79b81227d882c01426', 'request_id': 'req-65a41e64-5284-42ff-9d66-9b153eddc912'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:57.652919 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62a407c39884c79b81227d882c01426', 'request_id': 'req-65a41e64-5284-42ff-9d66-9b153eddc912'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:57.666909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] The token cache is being invalidate because project a62a407c39884c79b81227d882c01426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:57.667364 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:57.668579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65a41e64-5284-42ff-9d66-9b153eddc912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:57.669733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1331/2657] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:57 2022] DELETE /identity/v3/projects/a62a407c39884c79b81227d882c01426 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:10:57.674718 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b491a6-62b7-45a2-b52b-1e05eeb8b8fe None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:57.675089 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b491a6-62b7-45a2-b52b-1e05eeb8b8fe None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:57.675477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b491a6-62b7-45a2-b52b-1e05eeb8b8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:57.700845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-a6b491a6-62b7-45a2-b52b-1e05eeb8b8fe None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:57.702263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-a6b491a6-62b7-45a2-b52b-1e05eeb8b8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:57.780276 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1327/2658] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:57.800622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad70c31-ae7a-4f04-aa58-28c9090f8ced None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:57.800622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad70c31-ae7a-4f04-aa58-28c9090f8ced None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:57.800622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad70c31-ae7a-4f04-aa58-28c9090f8ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:57.815585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fad70c31-ae7a-4f04-aa58-28c9090f8ced None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:57.817168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fad70c31-ae7a-4f04-aa58-28c9090f8ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:57.827200 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1332/2659] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:57.831734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b491a6-62b7-45a2-b52b-1e05eeb8b8fe None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:57.855886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b491a6-62b7-45a2-b52b-1e05eeb8b8fe None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:57.855886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbd98-e28b-4b06-b401-b16c8371bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:57.855886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbd98-e28b-4b06-b401-b16c8371bdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:57.855886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbd98-e28b-4b06-b401-b16c8371bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:57.856242 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dbd98-e28b-4b06-b401-b16c8371bdb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:57.858527 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dbd98-e28b-4b06-b401-b16c8371bdb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:10:57.859926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dbd98-e28b-4b06-b401-b16c8371bdb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:57.862903 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dbd98-e28b-4b06-b401-b16c8371bdb6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:57.885422 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1328/2660] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:10:57.889999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad70c31-ae7a-4f04-aa58-28c9090f8ced None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:57.901699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad70c31-ae7a-4f04-aa58-28c9090f8ced None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:57.907708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7837-5853-4186-8ac0-0a75c7f88b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:57.908840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7837-5853-4186-8ac0-0a75c7f88b96 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:57.909471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7837-5853-4186-8ac0-0a75c7f88b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:57.910024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7837-5853-4186-8ac0-0a75c7f88b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:57.911126 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e7837-5853-4186-8ac0-0a75c7f88b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:57.913758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e7837-5853-4186-8ac0-0a75c7f88b96 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:57.979729 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbd98-e28b-4b06-b401-b16c8371bdb6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:57.981785 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6e0dbd98-e28b-4b06-b401-b16c8371bdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:58.002719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dbd98-e28b-4b06-b401-b16c8371bdb6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.011622 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1333/2661] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:57 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:58.016229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7837-5853-4186-8ac0-0a75c7f88b96 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.024900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.025580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.025863 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.026674 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] PATH_INFO: `/v3/projects/d58221f7a7344b28af2d9a7ce314c746` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.029374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58221f7a7344b28af2d9a7ce314c746)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.031399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.101436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7837-5853-4186-8ac0-0a75c7f88b96 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.107102 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379229c-8d48-4198-91fa-1b513a613111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.107765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379229c-8d48-4198-91fa-1b513a613111 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.108044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379229c-8d48-4198-91fa-1b513a613111 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.108314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379229c-8d48-4198-91fa-1b513a613111 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.108942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379229c-8d48-4198-91fa-1b513a613111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.113449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379229c-8d48-4198-91fa-1b513a613111 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.187308 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58221f7a7344b28af2d9a7ce314c746', 'request_id': 'req-5920c9cf-a371-482d-9e28-5a9131148bf1'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:58.199891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58221f7a7344b28af2d9a7ce314c746', 'request_id': 'req-5920c9cf-a371-482d-9e28-5a9131148bf1'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:58.202319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1334/2662] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:58 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:58.203982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379229c-8d48-4198-91fa-1b513a613111 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.219104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379229c-8d48-4198-91fa-1b513a613111 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.280406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cf588-c6b6-4396-b157-e77b4f562693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.281019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cf588-c6b6-4396-b157-e77b4f562693 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.281313 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cf588-c6b6-4396-b157-e77b4f562693 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.281584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cf588-c6b6-4396-b157-e77b4f562693 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.282224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cf588-c6b6-4396-b157-e77b4f562693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.283801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cf588-c6b6-4396-b157-e77b4f562693 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.289618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58221f7a7344b28af2d9a7ce314c746', 'request_id': 'req-5920c9cf-a371-482d-9e28-5a9131148bf1'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:58.300919 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1335/2663] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:58.301928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cf588-c6b6-4396-b157-e77b4f562693 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.314073 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cf588-c6b6-4396-b157-e77b4f562693 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.314545 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] The token cache is being invalidate because project d58221f7a7344b28af2d9a7ce314c746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:10:58.315504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:58.316988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-5920c9cf-a371-482d-9e28-5a9131148bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:10:58.319672 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1329/2664] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:10:57 2022] DELETE /identity/v3/projects/d58221f7a7344b28af2d9a7ce314c746 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:10:58.325036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7b3c3-327e-440c-a731-02976e820ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.325631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff02da-b6dd-4a77-9b3b-17031d83001a None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.325855 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7b3c3-327e-440c-a731-02976e820ccb admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.326137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7b3c3-327e-440c-a731-02976e820ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.326392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff02da-b6dd-4a77-9b3b-17031d83001a None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.326530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7b3c3-327e-440c-a731-02976e820ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.326936 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff02da-b6dd-4a77-9b3b-17031d83001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.327056 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7b3c3-327e-440c-a731-02976e820ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.328692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7b3c3-327e-440c-a731-02976e820ccb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.342468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1336/2665] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:58.347847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7b3c3-327e-440c-a731-02976e820ccb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.348990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c8f7b3c3-327e-440c-a731-02976e820ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:58.359660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9aff02da-b6dd-4a77-9b3b-17031d83001a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:58.361113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9aff02da-b6dd-4a77-9b3b-17031d83001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:58.362388 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7b3c3-327e-440c-a731-02976e820ccb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.368804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fe104-d202-46cd-8c5a-d76b27fb2348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.369512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe104-d202-46cd-8c5a-d76b27fb2348 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.370390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe104-d202-46cd-8c5a-d76b27fb2348 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.372910 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fe104-d202-46cd-8c5a-d76b27fb2348 admin admin] PATH_INFO: `/v3/projects/9173da02f3324dc6b229f4b1bce0b00c/users/e026c77e3d5b4028a122b44e17a8459d/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.384218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1330/2666] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:58.393774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c4286-ee7c-4d92-b19d-911fb084d132 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.394337 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c4286-ee7c-4d92-b19d-911fb084d132 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.394880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c4286-ee7c-4d92-b19d-911fb084d132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.395171 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fe104-d202-46cd-8c5a-d76b27fb2348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9173da02f3324dc6b229f4b1bce0b00c, user_id=e026c77e3d5b4028a122b44e17a8459d, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.400017 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fe104-d202-46cd-8c5a-d76b27fb2348 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.415384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-020c4286-ee7c-4d92-b19d-911fb084d132 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:58.416590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-020c4286-ee7c-4d92-b19d-911fb084d132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:58.424498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1331/2667] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:10:58.428603 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c4286-ee7c-4d92-b19d-911fb084d132 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.439000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c4286-ee7c-4d92-b19d-911fb084d132 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.443591 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98b47e-dee8-49c3-80b3-f6d63a68ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.444182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98b47e-dee8-49c3-80b3-f6d63a68ceac admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.444461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98b47e-dee8-49c3-80b3-f6d63a68ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.444727 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98b47e-dee8-49c3-80b3-f6d63a68ceac admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.445959 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98b47e-dee8-49c3-80b3-f6d63a68ceac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:10:58.446256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98b47e-dee8-49c3-80b3-f6d63a68ceac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.447830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98b47e-dee8-49c3-80b3-f6d63a68ceac admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.463834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1332/2668] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:10:58.477972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98b47e-dee8-49c3-80b3-f6d63a68ceac admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.491185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98b47e-dee8-49c3-80b3-f6d63a68ceac admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.495623 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:58.499901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732c207-7717-4c75-9de9-749882365150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.507072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c207-7717-4c75-9de9-749882365150 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.507072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c207-7717-4c75-9de9-749882365150 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.507072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c207-7717-4c75-9de9-749882365150 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.507072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732c207-7717-4c75-9de9-749882365150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.507072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732c207-7717-4c75-9de9-749882365150 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.507428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1337/2669] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:58 2022] PUT /identity/v3/projects/9173da02f3324dc6b229f4b1bce0b00c/users/e026c77e3d5b4028a122b44e17a8459d/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:10:58.576685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976e7c-3be6-4ad2-958d-817c239f70f3 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.576974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976e7c-3be6-4ad2-958d-817c239f70f3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.577248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976e7c-3be6-4ad2-958d-817c239f70f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.604109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1333/2670] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:58 2022] POST /identity/v3/projects => generated 361 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:58.606553 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8f976e7c-3be6-4ad2-958d-817c239f70f3 None None] MFA Rules not processed for user `e026c77e3d5b4028a122b44e17a8459d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:58.607773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8f976e7c-3be6-4ad2-958d-817c239f70f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:58.608566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732c207-7717-4c75-9de9-749882365150 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.614552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:58.678239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732c207-7717-4c75-9de9-749882365150 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.684122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1338/2671] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:10:58.685838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132256a-5190-4e4f-8a1f-177d5bcfbced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.687141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132256a-5190-4e4f-8a1f-177d5bcfbced admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.687552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132256a-5190-4e4f-8a1f-177d5bcfbced admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.689456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132256a-5190-4e4f-8a1f-177d5bcfbced admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.690127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132256a-5190-4e4f-8a1f-177d5bcfbced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.692489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132256a-5190-4e4f-8a1f-177d5bcfbced admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.694004 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976e7c-3be6-4ad2-958d-817c239f70f3 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.713492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976e7c-3be6-4ad2-958d-817c239f70f3 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.718564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbbcd4-cc5e-494c-a171-437a47c0d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.719177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbbcd4-cc5e-494c-a171-437a47c0d309 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.719452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbbcd4-cc5e-494c-a171-437a47c0d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.719719 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbbcd4-cc5e-494c-a171-437a47c0d309 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.720340 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbbcd4-cc5e-494c-a171-437a47c0d309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.722541 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbbcd4-cc5e-494c-a171-437a47c0d309 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.799045 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1334/2672] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:58 2022] POST /identity/v3/users => generated 281 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:58.806189 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132256a-5190-4e4f-8a1f-177d5bcfbced admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.816347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132256a-5190-4e4f-8a1f-177d5bcfbced admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.821325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6440d-1d64-4132-899e-73ab6399f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.821947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6440d-1d64-4132-899e-73ab6399f94d admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.822222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6440d-1d64-4132-899e-73ab6399f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.822625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6440d-1d64-4132-899e-73ab6399f94d admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.823459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6440d-1d64-4132-899e-73ab6399f94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.825342 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6440d-1d64-4132-899e-73ab6399f94d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.839311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1339/2673] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:58 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:10:58.839679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1335/2674] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:58.841082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6440d-1d64-4132-899e-73ab6399f94d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.841203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbbcd4-cc5e-494c-a171-437a47c0d309 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.854996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6440d-1d64-4132-899e-73ab6399f94d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.915154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbbcd4-cc5e-494c-a171-437a47c0d309 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.921740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f3acb-3264-44bb-9cb7-7bd9c0baa672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.922650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f3acb-3264-44bb-9cb7-7bd9c0baa672 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.923083 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f3acb-3264-44bb-9cb7-7bd9c0baa672 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.923531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f3acb-3264-44bb-9cb7-7bd9c0baa672 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.924387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f3acb-3264-44bb-9cb7-7bd9c0baa672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.927494 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f3acb-3264-44bb-9cb7-7bd9c0baa672 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.933138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca39bea-eea3-472a-adfe-b87eb94df1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.936275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca39bea-eea3-472a-adfe-b87eb94df1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.936275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca39bea-eea3-472a-adfe-b87eb94df1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.936275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca39bea-eea3-472a-adfe-b87eb94df1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.936275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca39bea-eea3-472a-adfe-b87eb94df1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.936804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca39bea-eea3-472a-adfe-b87eb94df1d0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:58.949120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1336/2675] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:58.953954 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca39bea-eea3-472a-adfe-b87eb94df1d0 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:58.965182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca39bea-eea3-472a-adfe-b87eb94df1d0 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:58.971502 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaff420-02a6-470a-99bc-6618952386fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:58.972236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff420-02a6-470a-99bc-6618952386fe admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:58.972586 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff420-02a6-470a-99bc-6618952386fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:58.972960 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaff420-02a6-470a-99bc-6618952386fe admin admin] PATH_INFO: `/v3/projects/57f9b222af67408b9f4205d24832c2d9/users/582f5f199a264e568473a319df795c8e/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:58.994606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaff420-02a6-470a-99bc-6618952386fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f9b222af67408b9f4205d24832c2d9, user_id=582f5f199a264e568473a319df795c8e, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:58.994606 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaff420-02a6-470a-99bc-6618952386fe admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.018928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1340/2676] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:58 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:59.025028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f3acb-3264-44bb-9cb7-7bd9c0baa672 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.034554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f3acb-3264-44bb-9cb7-7bd9c0baa672 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.039706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca3b89-996f-46d0-84fb-86ab55f035a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.040278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca3b89-996f-46d0-84fb-86ab55f035a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.040548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca3b89-996f-46d0-84fb-86ab55f035a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.040810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca3b89-996f-46d0-84fb-86ab55f035a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.041508 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca3b89-996f-46d0-84fb-86ab55f035a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.043111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca3b89-996f-46d0-84fb-86ab55f035a0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.052686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1341/2677] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:59.057133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca3b89-996f-46d0-84fb-86ab55f035a0 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.066223 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca3b89-996f-46d0-84fb-86ab55f035a0 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.071862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f04ef4-b71b-4690-bd12-e07f0df954a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.072523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f04ef4-b71b-4690-bd12-e07f0df954a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.081134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f04ef4-b71b-4690-bd12-e07f0df954a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.081134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f04ef4-b71b-4690-bd12-e07f0df954a6 admin admin] PATH_INFO: `/v3/projects/84319cb954f44ca382695e6871151e4a/users/bf1ab76af13d42b78d5b367f9593a362/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.081364 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1337/2678] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:58 2022] PUT /identity/v3/projects/57f9b222af67408b9f4205d24832c2d9/users/582f5f199a264e568473a319df795c8e/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:10:59.090766 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a941d3f-459e-48e9-8298-a4d0e7cd6097 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.091131 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a941d3f-459e-48e9-8298-a4d0e7cd6097 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.091469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a941d3f-459e-48e9-8298-a4d0e7cd6097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.096595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f04ef4-b71b-4690-bd12-e07f0df954a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84319cb954f44ca382695e6871151e4a, user_id=bf1ab76af13d42b78d5b367f9593a362, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.099270 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f04ef4-b71b-4690-bd12-e07f0df954a6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.125742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-2a941d3f-459e-48e9-8298-a4d0e7cd6097 None None] MFA Rules not processed for user `582f5f199a264e568473a319df795c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:59.126966 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2a941d3f-459e-48e9-8298-a4d0e7cd6097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:59.183457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1342/2679] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:59 2022] PUT /identity/v3/projects/84319cb954f44ca382695e6871151e4a/users/bf1ab76af13d42b78d5b367f9593a362/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:10:59.187424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f04ef4-b71b-4690-bd12-e07f0df954a6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.199613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1338/2680] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:10:59.202683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a941d3f-459e-48e9-8298-a4d0e7cd6097 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.248866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f04ef4-b71b-4690-bd12-e07f0df954a6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.254031 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733cd01-365d-4ae0-a867-090772343aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.254828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733cd01-365d-4ae0-a867-090772343aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.255186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733cd01-365d-4ae0-a867-090772343aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.255528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733cd01-365d-4ae0-a867-090772343aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.256234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733cd01-365d-4ae0-a867-090772343aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.258050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733cd01-365d-4ae0-a867-090772343aa5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.263496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a941d3f-459e-48e9-8298-a4d0e7cd6097 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.267840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1343/2681] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:10:59.268065 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad0d88-6740-497e-a972-6a938c34ca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.268665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad0d88-6740-497e-a972-6a938c34ca3f admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.268940 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad0d88-6740-497e-a972-6a938c34ca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.269210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad0d88-6740-497e-a972-6a938c34ca3f admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.269880 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad0d88-6740-497e-a972-6a938c34ca3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.271796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad0d88-6740-497e-a972-6a938c34ca3f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.272554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733cd01-365d-4ae0-a867-090772343aa5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.286650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733cd01-365d-4ae0-a867-090772343aa5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.292418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f992fa6-1088-4e2e-9934-d2081dcfeb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.293137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f992fa6-1088-4e2e-9934-d2081dcfeb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.293456 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f992fa6-1088-4e2e-9934-d2081dcfeb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.293730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f992fa6-1088-4e2e-9934-d2081dcfeb70 admin admin] PATH_INFO: `/v3/projects/84319cb954f44ca382695e6871151e4a/users/bf1ab76af13d42b78d5b367f9593a362/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.297427 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f992fa6-1088-4e2e-9934-d2081dcfeb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84319cb954f44ca382695e6871151e4a, user_id=bf1ab76af13d42b78d5b367f9593a362, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.300133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f992fa6-1088-4e2e-9934-d2081dcfeb70 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.310671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1344/2682] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:59 2022] PUT /identity/v3/projects/84319cb954f44ca382695e6871151e4a/users/bf1ab76af13d42b78d5b367f9593a362/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:10:59.320799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205385f-23ee-45a6-8920-2ebf7ad28ab9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.321079 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205385f-23ee-45a6-8920-2ebf7ad28ab9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.321384 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205385f-23ee-45a6-8920-2ebf7ad28ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.348134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6205385f-23ee-45a6-8920-2ebf7ad28ab9 None None] MFA Rules not processed for user `bf1ab76af13d42b78d5b367f9593a362`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:59.349345 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6205385f-23ee-45a6-8920-2ebf7ad28ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:59.391775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1339/2683] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:10:59 2022] POST /identity/v3/projects => generated 365 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:59.395241 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad0d88-6740-497e-a972-6a938c34ca3f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.422732 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1345/2684] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:10:59.434996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205385f-23ee-45a6-8920-2ebf7ad28ab9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.436645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6205385f-23ee-45a6-8920-2ebf7ad28ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:10:59.469547 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad0d88-6740-497e-a972-6a938c34ca3f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.473205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f147a-0d45-416f-8b9d-3c120122ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.473838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f147a-0d45-416f-8b9d-3c120122ff6b admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.474107 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f147a-0d45-416f-8b9d-3c120122ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.474522 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f147a-0d45-416f-8b9d-3c120122ff6b admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.475138 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f147a-0d45-416f-8b9d-3c120122ff6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.477675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f147a-0d45-416f-8b9d-3c120122ff6b admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.491564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205385f-23ee-45a6-8920-2ebf7ad28ab9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.540692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1fda9-a3ed-4796-8dc7-0568d6ce9af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.541398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1fda9-a3ed-4796-8dc7-0568d6ce9af4 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.541645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1fda9-a3ed-4796-8dc7-0568d6ce9af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.541922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1fda9-a3ed-4796-8dc7-0568d6ce9af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.577324 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1340/2685] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:10:59 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:10:59.579616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f147a-0d45-416f-8b9d-3c120122ff6b admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.589799 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f147a-0d45-416f-8b9d-3c120122ff6b admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.594568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7268-ca64-4894-8c86-5dd4f6e26023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.595154 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7268-ca64-4894-8c86-5dd4f6e26023 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.595428 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7268-ca64-4894-8c86-5dd4f6e26023 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.595696 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7268-ca64-4894-8c86-5dd4f6e26023 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.596639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7268-ca64-4894-8c86-5dd4f6e26023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.599400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7268-ca64-4894-8c86-5dd4f6e26023 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.602112 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1fda9-a3ed-4796-8dc7-0568d6ce9af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.603540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1fda9-a3ed-4796-8dc7-0568d6ce9af4 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.609425 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1341/2686] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:10:59.612695 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1346/2687] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:10:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:10:59.613453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7268-ca64-4894-8c86-5dd4f6e26023 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.623108 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7268-ca64-4894-8c86-5dd4f6e26023 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.627965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded0d9f-9232-41a9-8400-70abbe406221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.628599 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded0d9f-9232-41a9-8400-70abbe406221 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.628872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded0d9f-9232-41a9-8400-70abbe406221 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.629139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded0d9f-9232-41a9-8400-70abbe406221 admin admin] PATH_INFO: `/v3/projects/72b66c3dffe24d83bb20207030c4f2b2/users/46da52fc18d84dc8b10ac22a69c816a7/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.644478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded0d9f-9232-41a9-8400-70abbe406221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b66c3dffe24d83bb20207030c4f2b2, user_id=46da52fc18d84dc8b10ac22a69c816a7, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.653340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded0d9f-9232-41a9-8400-70abbe406221 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.779423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1342/2688] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:59 2022] PUT /identity/v3/projects/72b66c3dffe24d83bb20207030c4f2b2/users/46da52fc18d84dc8b10ac22a69c816a7/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:10:59.783469 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1fda9-a3ed-4796-8dc7-0568d6ce9af4 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.787672 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:59.797993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1fda9-a3ed-4796-8dc7-0568d6ce9af4 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.835361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:59.856503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f934f3-04cb-4e14-a2ed-c27391e8f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.857104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f934f3-04cb-4e14-a2ed-c27391e8f145 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.857409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f934f3-04cb-4e14-a2ed-c27391e8f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.857677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f934f3-04cb-4e14-a2ed-c27391e8f145 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.858301 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f934f3-04cb-4e14-a2ed-c27391e8f145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.859955 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f934f3-04cb-4e14-a2ed-c27391e8f145 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.872759 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1347/2689] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:10:59.874152 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded0d9f-9232-41a9-8400-70abbe406221 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:10:59.884980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded0d9f-9232-41a9-8400-70abbe406221 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:10:59.889919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5ff5-34d4-42db-b6e0-8c6263bfb030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:10:59.890569 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5ff5-34d4-42db-b6e0-8c6263bfb030 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.890841 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5ff5-34d4-42db-b6e0-8c6263bfb030 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.891160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5ff5-34d4-42db-b6e0-8c6263bfb030 admin admin] PATH_INFO: `/v3/projects/72b66c3dffe24d83bb20207030c4f2b2/users/46da52fc18d84dc8b10ac22a69c816a7/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.893336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5ff5-34d4-42db-b6e0-8c6263bfb030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b66c3dffe24d83bb20207030c4f2b2, user_id=46da52fc18d84dc8b10ac22a69c816a7, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:10:59.896728 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5ff5-34d4-42db-b6e0-8c6263bfb030 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:10:59.908837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1343/2690] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:10:59 2022] PUT /identity/v3/projects/72b66c3dffe24d83bb20207030c4f2b2/users/46da52fc18d84dc8b10ac22a69c816a7/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:10:59.920632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9fd9c-8497-4c6a-9752-e29390ce207e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:10:59.920943 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9fd9c-8497-4c6a-9752-e29390ce207e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:10:59.921219 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9fd9c-8497-4c6a-9752-e29390ce207e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:10:59.949396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-73a9fd9c-8497-4c6a-9752-e29390ce207e None None] MFA Rules not processed for user `46da52fc18d84dc8b10ac22a69c816a7`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:10:59.950617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-73a9fd9c-8497-4c6a-9752-e29390ce207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:00.021685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1348/2691] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:10:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:00.033187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5ff5-34d4-42db-b6e0-8c6263bfb030 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:00.087653 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5ff5-34d4-42db-b6e0-8c6263bfb030 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:00.091303 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cf15f-b302-473c-8d56-5306012a6a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:00.091900 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cf15f-b302-473c-8d56-5306012a6a38 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:00.092194 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cf15f-b302-473c-8d56-5306012a6a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:00.092458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cf15f-b302-473c-8d56-5306012a6a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:00.101837 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cf15f-b302-473c-8d56-5306012a6a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:00.105257 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cf15f-b302-473c-8d56-5306012a6a38 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:00.112953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1344/2692] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:11:00.326077 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9fd9c-8497-4c6a-9752-e29390ce207e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:00.336104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9fd9c-8497-4c6a-9752-e29390ce207e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:00.339729 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a3105-016d-4640-bf1f-dc3309411959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:00.340393 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a3105-016d-4640-bf1f-dc3309411959 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:00.340733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a3105-016d-4640-bf1f-dc3309411959 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:00.341068 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a3105-016d-4640-bf1f-dc3309411959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:00.399488 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a3105-016d-4640-bf1f-dc3309411959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:00.400964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a3105-016d-4640-bf1f-dc3309411959 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:00.409857 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1349/2693] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:00.472932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:00.820950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:01.276887 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:04.823828 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cf15f-b302-473c-8d56-5306012a6a38 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:04.834370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cf15f-b302-473c-8d56-5306012a6a38 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:04.837170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c465a-ade5-4d2f-a945-903e3cb7cceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:04.837804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c465a-ade5-4d2f-a945-903e3cb7cceb service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:04.838080 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c465a-ade5-4d2f-a945-903e3cb7cceb service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:04.838348 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c465a-ade5-4d2f-a945-903e3cb7cceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:04.903203 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c465a-ade5-4d2f-a945-903e3cb7cceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:04.903625 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c465a-ade5-4d2f-a945-903e3cb7cceb service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:04.913767 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1345/2694] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:09.400067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a3105-016d-4640-bf1f-dc3309411959 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:09.461206 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a3105-016d-4640-bf1f-dc3309411959 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:09.465825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:09.466368 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:09.466766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:09.466913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] PATH_INFO: `/v3/users/582f5f199a264e568473a319df795c8e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:09.468016 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=582f5f199a264e568473a319df795c8e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:09.469950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:09.674970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582f5f199a264e568473a319df795c8e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:09.679515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:09.687234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582f5f199a264e568473a319df795c8e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:09.687951 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582f5f199a264e568473a319df795c8e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:09.688550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582f5f199a264e568473a319df795c8e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:09.790494 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582f5f199a264e568473a319df795c8e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:09.803964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1350/2695] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:09 2022] DELETE /identity/v3/users/582f5f199a264e568473a319df795c8e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:09.808479 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9414b70-c138-447d-b08c-1307abc14d78 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:09.808975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9414b70-c138-447d-b08c-1307abc14d78 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:09.809232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9414b70-c138-447d-b08c-1307abc14d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:09.828102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b9414b70-c138-447d-b08c-1307abc14d78 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:09.829535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b9414b70-c138-447d-b08c-1307abc14d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:09.886991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1346/2696] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:09.896906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:09.898328 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:09.955190 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d98d7-5045-4983-9461-b37e9dd2c174 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:09.958743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066311a-c2ce-4335-9620-9853911fcef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:09.959573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066311a-c2ce-4335-9620-9853911fcef2 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:09.959723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066311a-c2ce-4335-9620-9853911fcef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:09.959996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066311a-c2ce-4335-9620-9853911fcef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:09.969448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066311a-c2ce-4335-9620-9853911fcef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:09.978405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066311a-c2ce-4335-9620-9853911fcef2 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:09.980842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1351/2697] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:10.367715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9414b70-c138-447d-b08c-1307abc14d78 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:10.371177 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b9414b70-c138-447d-b08c-1307abc14d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:10.382552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9414b70-c138-447d-b08c-1307abc14d78 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:10.388198 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:10.388853 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:10.389125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:10.390284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] PATH_INFO: `/v3/projects/57f9b222af67408b9f4205d24832c2d9` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:10.391646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f9b222af67408b9f4205d24832c2d9)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:10.393668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:10.514922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:10.518556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f9b222af67408b9f4205d24832c2d9', 'request_id': 'req-089b9866-5bce-46c8-8dc4-2472304afab2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:10.524645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f9b222af67408b9f4205d24832c2d9', 'request_id': 'req-089b9866-5bce-46c8-8dc4-2472304afab2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:10.637801 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f9b222af67408b9f4205d24832c2d9', 'request_id': 'req-089b9866-5bce-46c8-8dc4-2472304afab2'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:10.648336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] The token cache is being invalidate because project 57f9b222af67408b9f4205d24832c2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:10.651952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:10.651952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:10.651952 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1347/2698] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:10 2022] DELETE /identity/v3/projects/57f9b222af67408b9f4205d24832c2d9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:10.654716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066311a-c2ce-4335-9620-9853911fcef2 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:10.664164 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066311a-c2ce-4335-9620-9853911fcef2 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:10.719192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:10.719847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:10.720124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:10.720396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] PATH_INFO: `/v3/users/46da52fc18d84dc8b10ac22a69c816a7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:10.721833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46da52fc18d84dc8b10ac22a69c816a7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:10.723794 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:10.845436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:10.847148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:10.860176 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b9866-5bce-46c8-8dc4-2472304afab2 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:10.864790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:10.865473 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:10.865795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:10.866013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] PATH_INFO: `/v3/users/e026c77e3d5b4028a122b44e17a8459d` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:10.867124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e026c77e3d5b4028a122b44e17a8459d)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:10.870306 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:10.880782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46da52fc18d84dc8b10ac22a69c816a7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:10.894332 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46da52fc18d84dc8b10ac22a69c816a7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:10.895142 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46da52fc18d84dc8b10ac22a69c816a7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:10.895771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46da52fc18d84dc8b10ac22a69c816a7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:10.974573 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-311341a9-cd60-49c6-9b39-602a68badd83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46da52fc18d84dc8b10ac22a69c816a7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:10.976846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:10.987860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1352/2699] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:10 2022] DELETE /identity/v3/users/46da52fc18d84dc8b10ac22a69c816a7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:11.026311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e026c77e3d5b4028a122b44e17a8459d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.033609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e026c77e3d5b4028a122b44e17a8459d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.047053 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e026c77e3d5b4028a122b44e17a8459d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.047745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e026c77e3d5b4028a122b44e17a8459d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.049408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e026c77e3d5b4028a122b44e17a8459d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.195368 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1348/2700] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:10 2022] DELETE /identity/v3/users/e026c77e3d5b4028a122b44e17a8459d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:11.201012 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137904b-93e9-4242-a12d-4d6975dc632a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:11.201761 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137904b-93e9-4242-a12d-4d6975dc632a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:11.209026 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137904b-93e9-4242-a12d-4d6975dc632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:11.223415 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d137904b-93e9-4242-a12d-4d6975dc632a None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:11.224625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d137904b-93e9-4242-a12d-4d6975dc632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:11.286628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1353/2701] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:11:11.296581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:11.298122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:11.357112 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28350f-e9ea-4b1f-9b85-99742c174aad admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:11.360734 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0933f6-71e6-4456-8f16-9f4ae1dceca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:11.361399 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0933f6-71e6-4456-8f16-9f4ae1dceca9 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:11.361640 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0933f6-71e6-4456-8f16-9f4ae1dceca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:11.361907 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0933f6-71e6-4456-8f16-9f4ae1dceca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:11.371699 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0933f6-71e6-4456-8f16-9f4ae1dceca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:11.373099 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0933f6-71e6-4456-8f16-9f4ae1dceca9 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:11.382485 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1349/2702] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:11.455733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137904b-93e9-4242-a12d-4d6975dc632a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:11.456322 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d137904b-93e9-4242-a12d-4d6975dc632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:11.469965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137904b-93e9-4242-a12d-4d6975dc632a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:11.475797 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:11.476442 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:11.476690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:11.476957 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] PATH_INFO: `/v3/projects/72b66c3dffe24d83bb20207030c4f2b2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:11.484892 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b66c3dffe24d83bb20207030c4f2b2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:11.486871 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:11.625260 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b66c3dffe24d83bb20207030c4f2b2', 'request_id': 'req-94fd5407-1231-4919-a917-61dc1aa37964'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.632047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b66c3dffe24d83bb20207030c4f2b2', 'request_id': 'req-94fd5407-1231-4919-a917-61dc1aa37964'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.730097 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b66c3dffe24d83bb20207030c4f2b2', 'request_id': 'req-94fd5407-1231-4919-a917-61dc1aa37964'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.741138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] The token cache is being invalidate because project 72b66c3dffe24d83bb20207030c4f2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:11.744530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.744530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94fd5407-1231-4919-a917-61dc1aa37964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.744530 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1354/2703] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:11 2022] DELETE /identity/v3/projects/72b66c3dffe24d83bb20207030c4f2b2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:11.749197 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e1ac-89c9-4251-9f33-c6122f3b3acb None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:11.749511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e1ac-89c9-4251-9f33-c6122f3b3acb None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:11.749784 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e1ac-89c9-4251-9f33-c6122f3b3acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:11.769317 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-3cd0e1ac-89c9-4251-9f33-c6122f3b3acb None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:11.770533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3cd0e1ac-89c9-4251-9f33-c6122f3b3acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:11.812306 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:11.828560 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1350/2704] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:11.836303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536501a-90d7-4157-8c2a-e8ec55897b66 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:11.836651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536501a-90d7-4157-8c2a-e8ec55897b66 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:11.836923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536501a-90d7-4157-8c2a-e8ec55897b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:11.852006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e1ac-89c9-4251-9f33-c6122f3b3acb None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:11.854139 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-3cd0e1ac-89c9-4251-9f33-c6122f3b3acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:11.857533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9536501a-90d7-4157-8c2a-e8ec55897b66 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:11.859581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9536501a-90d7-4157-8c2a-e8ec55897b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:11.866030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e1ac-89c9-4251-9f33-c6122f3b3acb None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:11.870963 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1355/2705] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:11.872865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:11.873618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536501a-90d7-4157-8c2a-e8ec55897b66 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:11.874371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:11.874861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:11.875232 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] PATH_INFO: `/v3/projects/9173da02f3324dc6b229f4b1bce0b00c` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:11.876707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9173da02f3324dc6b229f4b1bce0b00c)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:11.880533 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:11.884013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536501a-90d7-4157-8c2a-e8ec55897b66 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:11.889248 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6cda4-e035-4d2f-bcf9-2b54624a5d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:11.890040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6cda4-e035-4d2f-bcf9-2b54624a5d66 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:11.890394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6cda4-e035-4d2f-bcf9-2b54624a5d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:11.890662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6cda4-e035-4d2f-bcf9-2b54624a5d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:11.891305 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6cda4-e035-4d2f-bcf9-2b54624a5d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:11:11.891596 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6cda4-e035-4d2f-bcf9-2b54624a5d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:11.893177 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6cda4-e035-4d2f-bcf9-2b54624a5d66 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:11.907779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1356/2706] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:11:11.909687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6cda4-e035-4d2f-bcf9-2b54624a5d66 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:11.919828 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6cda4-e035-4d2f-bcf9-2b54624a5d66 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:11.925190 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bed032-2218-49f5-acd2-6b0a1254dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:11.927829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bed032-2218-49f5-acd2-6b0a1254dd11 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:11.927829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bed032-2218-49f5-acd2-6b0a1254dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:11.927829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bed032-2218-49f5-acd2-6b0a1254dd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:11.927829 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bed032-2218-49f5-acd2-6b0a1254dd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:11.929742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bed032-2218-49f5-acd2-6b0a1254dd11 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:11.981693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9173da02f3324dc6b229f4b1bce0b00c', 'request_id': 'req-647e6cb4-1869-4003-ba2b-7006880f69d7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:11.988484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9173da02f3324dc6b229f4b1bce0b00c', 'request_id': 'req-647e6cb4-1869-4003-ba2b-7006880f69d7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:12.053764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1357/2707] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:11 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:11:12.065181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bed032-2218-49f5-acd2-6b0a1254dd11 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:12.100572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9173da02f3324dc6b229f4b1bce0b00c', 'request_id': 'req-647e6cb4-1869-4003-ba2b-7006880f69d7'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:12.101460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:12.112436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] The token cache is being invalidate because project 9173da02f3324dc6b229f4b1bce0b00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:12.114136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:12.114136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:12.115292 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1351/2708] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:11 2022] DELETE /identity/v3/projects/9173da02f3324dc6b229f4b1bce0b00c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:12.119127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:12.120417 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:12.131373 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bed032-2218-49f5-acd2-6b0a1254dd11 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:12.136316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28305864-4064-4832-87de-50442fe2e638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:12.136923 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28305864-4064-4832-87de-50442fe2e638 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:12.137221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28305864-4064-4832-87de-50442fe2e638 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:12.137599 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28305864-4064-4832-87de-50442fe2e638 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:12.138242 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28305864-4064-4832-87de-50442fe2e638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:12.140127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28305864-4064-4832-87de-50442fe2e638 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:12.183955 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e6cb4-1869-4003-ba2b-7006880f69d7 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:12.188604 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:12.189227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:12.189523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:12.189793 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] PATH_INFO: `/v3/users/bf1ab76af13d42b78d5b367f9593a362` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:12.191021 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1ab76af13d42b78d5b367f9593a362)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:12.192971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:12.272323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1358/2709] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:12 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:11:12.277225 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28305864-4064-4832-87de-50442fe2e638 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:12.278985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-28305864-4064-4832-87de-50442fe2e638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:12.291307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28305864-4064-4832-87de-50442fe2e638 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:12.298632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6cad5-3e77-4570-b1cb-9fd379cbd862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:12.299249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6cad5-3e77-4570-b1cb-9fd379cbd862 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:12.299833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6cad5-3e77-4570-b1cb-9fd379cbd862 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:12.300161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6cad5-3e77-4570-b1cb-9fd379cbd862 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:12.300932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6cad5-3e77-4570-b1cb-9fd379cbd862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:12.302721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6cad5-3e77-4570-b1cb-9fd379cbd862 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:12.312897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1359/2710] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:11:12.317218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6cad5-3e77-4570-b1cb-9fd379cbd862 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:12.326836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6cad5-3e77-4570-b1cb-9fd379cbd862 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:12.331635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616782ae-07b6-4450-94bd-ac099e5b310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:12.332185 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616782ae-07b6-4450-94bd-ac099e5b310b admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:12.332461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616782ae-07b6-4450-94bd-ac099e5b310b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:12.332729 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616782ae-07b6-4450-94bd-ac099e5b310b admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:12.333361 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616782ae-07b6-4450-94bd-ac099e5b310b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:12.334883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616782ae-07b6-4450-94bd-ac099e5b310b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:12.345341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1360/2711] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:11:12.351737 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616782ae-07b6-4450-94bd-ac099e5b310b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:12.360630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616782ae-07b6-4450-94bd-ac099e5b310b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:12.365799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c6cb0-4240-4f3f-a98c-6c1c3a71cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:12.366388 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c6cb0-4240-4f3f-a98c-6c1c3a71cc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:12.366659 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c6cb0-4240-4f3f-a98c-6c1c3a71cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:12.366925 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c6cb0-4240-4f3f-a98c-6c1c3a71cc81 admin admin] PATH_INFO: `/v3/projects/978e1b930d4243c08238d460ddc406c9/users/e6b3b093c5e94f70885d5af44fe4d117/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:12.382744 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c6cb0-4240-4f3f-a98c-6c1c3a71cc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978e1b930d4243c08238d460ddc406c9, user_id=e6b3b093c5e94f70885d5af44fe4d117, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:12.385891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c6cb0-4240-4f3f-a98c-6c1c3a71cc81 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:12.394433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1ab76af13d42b78d5b367f9593a362'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:12.401857 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1ab76af13d42b78d5b367f9593a362'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:12.413698 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:12.414850 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1ab76af13d42b78d5b367f9593a362'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:12.415575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1ab76af13d42b78d5b367f9593a362'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:12.416204 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1ab76af13d42b78d5b367f9593a362'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:12.457963 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1361/2712] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:12 2022] PUT /identity/v3/projects/978e1b930d4243c08238d460ddc406c9/users/e6b3b093c5e94f70885d5af44fe4d117/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:12.468562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75eca-53d4-4db4-888e-0111cdecd718 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:12.468849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75eca-53d4-4db4-888e-0111cdecd718 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:12.469121 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75eca-53d4-4db4-888e-0111cdecd718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:12.486933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1352/2713] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:12 2022] DELETE /identity/v3/users/bf1ab76af13d42b78d5b367f9593a362 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:12.496551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-39c75eca-53d4-4db4-888e-0111cdecd718 None None] MFA Rules not processed for user `e6b3b093c5e94f70885d5af44fe4d117`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:12.497765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-39c75eca-53d4-4db4-888e-0111cdecd718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:12.577854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1362/2714] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:11:12.580213 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:12.581971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:12.647047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7e97-e1a5-4fc6-85e8-edc9bf106c3a admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:12.651651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d62eb-e1e0-4afd-83c7-24116533edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:12.652239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d62eb-e1e0-4afd-83c7-24116533edc4 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:12.652681 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d62eb-e1e0-4afd-83c7-24116533edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:12.653031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d62eb-e1e0-4afd-83c7-24116533edc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:12.653680 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d62eb-e1e0-4afd-83c7-24116533edc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:12.655592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d62eb-e1e0-4afd-83c7-24116533edc4 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:12.776471 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1353/2715] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:12 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:11:12.780746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c75eca-53d4-4db4-888e-0111cdecd718 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:12.792094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c75eca-53d4-4db4-888e-0111cdecd718 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:12.848686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a0f3b-a05c-4dab-97e3-0b523ff76378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:12.849315 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a0f3b-a05c-4dab-97e3-0b523ff76378 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:12.849579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a0f3b-a05c-4dab-97e3-0b523ff76378 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:12.849850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a0f3b-a05c-4dab-97e3-0b523ff76378 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:12.850466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a0f3b-a05c-4dab-97e3-0b523ff76378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:12.852351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a0f3b-a05c-4dab-97e3-0b523ff76378 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:12.868802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:12.930600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d62eb-e1e0-4afd-83c7-24116533edc4 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:12.933000 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-768d62eb-e1e0-4afd-83c7-24116533edc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:12.945780 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d62eb-e1e0-4afd-83c7-24116533edc4 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:12.951564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:12.952239 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:12.952572 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:12.952854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] PATH_INFO: `/v3/projects/84319cb954f44ca382695e6871151e4a` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:12.954440 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84319cb954f44ca382695e6871151e4a)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:12.957939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:12.960182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1363/2716] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:12 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:12.964027 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a0f3b-a05c-4dab-97e3-0b523ff76378 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:12.978660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a0f3b-a05c-4dab-97e3-0b523ff76378 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:12.984138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a14f80-42cd-498c-8edc-4d9122ba5839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:12.985303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a14f80-42cd-498c-8edc-4d9122ba5839 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:12.985616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a14f80-42cd-498c-8edc-4d9122ba5839 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:12.986064 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a14f80-42cd-498c-8edc-4d9122ba5839 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:12.986725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a14f80-42cd-498c-8edc-4d9122ba5839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:12.988443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a14f80-42cd-498c-8edc-4d9122ba5839 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:13.000506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1364/2717] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:11:13.004900 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a14f80-42cd-498c-8edc-4d9122ba5839 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:13.016562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a14f80-42cd-498c-8edc-4d9122ba5839 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:13.021535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb96750-709d-4af5-87b8-c2fceefca55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:13.022263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96750-709d-4af5-87b8-c2fceefca55d admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:13.022521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96750-709d-4af5-87b8-c2fceefca55d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:13.022791 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96750-709d-4af5-87b8-c2fceefca55d admin admin] PATH_INFO: `/v3/projects/0caad4de4cb04004a4c8a3701104edbf/users/07bdb7a7e33b4a82b1440ed338d47d07/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:13.041586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb96750-709d-4af5-87b8-c2fceefca55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0caad4de4cb04004a4c8a3701104edbf, user_id=07bdb7a7e33b4a82b1440ed338d47d07, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:13.044229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb96750-709d-4af5-87b8-c2fceefca55d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:13.117425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1365/2718] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:13 2022] PUT /identity/v3/projects/0caad4de4cb04004a4c8a3701104edbf/users/07bdb7a7e33b4a82b1440ed338d47d07/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:13.120862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb96750-709d-4af5-87b8-c2fceefca55d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:13.129478 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84319cb954f44ca382695e6871151e4a', 'request_id': 'req-17018a08-8b8c-404f-b41d-1433591b1925'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:13.136816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84319cb954f44ca382695e6871151e4a', 'request_id': 'req-17018a08-8b8c-404f-b41d-1433591b1925'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:13.190631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb96750-709d-4af5-87b8-c2fceefca55d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:13.206844 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84319cb954f44ca382695e6871151e4a', 'request_id': 'req-17018a08-8b8c-404f-b41d-1433591b1925'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:13.218460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] The token cache is being invalidate because project 84319cb954f44ca382695e6871151e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:13.218794 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:13.219460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:13.221254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1354/2719] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:12 2022] DELETE /identity/v3/projects/84319cb954f44ca382695e6871151e4a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:13.259970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640e135-a27f-4a6d-9413-bd24d8c6b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:13.260587 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e135-a27f-4a6d-9413-bd24d8c6b3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:13.260860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e135-a27f-4a6d-9413-bd24d8c6b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:13.261245 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e135-a27f-4a6d-9413-bd24d8c6b3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:13.261942 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640e135-a27f-4a6d-9413-bd24d8c6b3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:13.263580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640e135-a27f-4a6d-9413-bd24d8c6b3f0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:13.274907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1366/2720] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:11:13.279622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:13.293240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:13.299373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17018a08-8b8c-404f-b41d-1433591b1925 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:13.306616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a731b0-db7a-41b7-8f39-b609c1a7fc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:13.307697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a731b0-db7a-41b7-8f39-b609c1a7fc06 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:13.308260 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a731b0-db7a-41b7-8f39-b609c1a7fc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:13.308738 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a731b0-db7a-41b7-8f39-b609c1a7fc06 admin admin] PATH_INFO: `/v3/projects/0caad4de4cb04004a4c8a3701104edbf/users/07bdb7a7e33b4a82b1440ed338d47d07/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:13.312105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a731b0-db7a-41b7-8f39-b609c1a7fc06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0caad4de4cb04004a4c8a3701104edbf, user_id=07bdb7a7e33b4a82b1440ed338d47d07, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:13.315584 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a731b0-db7a-41b7-8f39-b609c1a7fc06 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:13.329494 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1355/2721] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:13 2022] PUT /identity/v3/projects/0caad4de4cb04004a4c8a3701104edbf/users/07bdb7a7e33b4a82b1440ed338d47d07/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:13.342310 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57158cb-8be2-465a-b383-ac9c0ead5494 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:13.342693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57158cb-8be2-465a-b383-ac9c0ead5494 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:13.343036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57158cb-8be2-465a-b383-ac9c0ead5494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:13.377969 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b57158cb-8be2-465a-b383-ac9c0ead5494 None None] MFA Rules not processed for user `07bdb7a7e33b4a82b1440ed338d47d07`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:13.379203 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b57158cb-8be2-465a-b383-ac9c0ead5494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:13.440626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:13.463397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1367/2722] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:13.476115 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a731b0-db7a-41b7-8f39-b609c1a7fc06 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:13.478896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-36a731b0-db7a-41b7-8f39-b609c1a7fc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:13.524111 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:13.535301 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a731b0-db7a-41b7-8f39-b609c1a7fc06 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:13.539006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118482d1-7c27-4aaa-8f71-34318f72ed2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:13.539660 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118482d1-7c27-4aaa-8f71-34318f72ed2c service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:13.540141 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118482d1-7c27-4aaa-8f71-34318f72ed2c service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:13.540932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118482d1-7c27-4aaa-8f71-34318f72ed2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:13.542976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-118482d1-7c27-4aaa-8f71-34318f72ed2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:13.615451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118482d1-7c27-4aaa-8f71-34318f72ed2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:13.616913 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118482d1-7c27-4aaa-8f71-34318f72ed2c service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:13.625583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1356/2723] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:15.355188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57158cb-8be2-465a-b383-ac9c0ead5494 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:15.364675 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57158cb-8be2-465a-b383-ac9c0ead5494 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:15.368540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514c133-f769-4e94-9a3f-5cd658c07d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:15.369138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c133-f769-4e94-9a3f-5cd658c07d7e service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:15.369462 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c133-f769-4e94-9a3f-5cd658c07d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:15.370376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c133-f769-4e94-9a3f-5cd658c07d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:15.379341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514c133-f769-4e94-9a3f-5cd658c07d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:15.380808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514c133-f769-4e94-9a3f-5cd658c07d7e service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:15.390478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1368/2724] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:19.710645 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118482d1-7c27-4aaa-8f71-34318f72ed2c service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:19.773238 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118482d1-7c27-4aaa-8f71-34318f72ed2c service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:19.778358 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:19.778972 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:19.779246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:19.779512 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] PATH_INFO: `/v3/users/e6b3b093c5e94f70885d5af44fe4d117` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:19.780613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b3b093c5e94f70885d5af44fe4d117)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:19.782538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:19.944932 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b3b093c5e94f70885d5af44fe4d117'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:19.952526 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b3b093c5e94f70885d5af44fe4d117'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:19.964953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b3b093c5e94f70885d5af44fe4d117'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:19.965602 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b3b093c5e94f70885d5af44fe4d117'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:19.966221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b3b093c5e94f70885d5af44fe4d117'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:20.045871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1357/2725] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:19 2022] DELETE /identity/v3/users/e6b3b093c5e94f70885d5af44fe4d117 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:20.050401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5a24d-e837-4935-85ef-b1a0637ff0b0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:20.050889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5a24d-e837-4935-85ef-b1a0637ff0b0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:20.050999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5a24d-e837-4935-85ef-b1a0637ff0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:20.069441 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-00b5a24d-e837-4935-85ef-b1a0637ff0b0 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:20.070608 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-00b5a24d-e837-4935-85ef-b1a0637ff0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:20.128710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1369/2726] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:11:20.138976 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:20.140423 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:20.159950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:20.196225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663ef71-61e2-47ab-ba1a-57c7751cafdb admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:20.200373 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5237-b5ec-465f-8111-fee59b2d02d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:20.200962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5237-b5ec-465f-8111-fee59b2d02d0 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:20.201236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5237-b5ec-465f-8111-fee59b2d02d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:20.201547 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5237-b5ec-465f-8111-fee59b2d02d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:20.210249 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f5237-b5ec-465f-8111-fee59b2d02d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:20.211647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f5237-b5ec-465f-8111-fee59b2d02d0 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:20.221206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1358/2727] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:20.625204 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5a24d-e837-4935-85ef-b1a0637ff0b0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:20.626823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-00b5a24d-e837-4935-85ef-b1a0637ff0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:20.639975 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5a24d-e837-4935-85ef-b1a0637ff0b0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:20.644666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:20.645517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:20.645854 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:20.646188 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] PATH_INFO: `/v3/projects/978e1b930d4243c08238d460ddc406c9` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:20.647371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978e1b930d4243c08238d460ddc406c9)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:20.649343 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:20.777432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978e1b930d4243c08238d460ddc406c9', 'request_id': 'req-6b4c6f5e-9947-4091-b823-f36642224558'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:20.783439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978e1b930d4243c08238d460ddc406c9', 'request_id': 'req-6b4c6f5e-9947-4091-b823-f36642224558'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:20.863766 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978e1b930d4243c08238d460ddc406c9', 'request_id': 'req-6b4c6f5e-9947-4091-b823-f36642224558'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:20.874397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] The token cache is being invalidate because project 978e1b930d4243c08238d460ddc406c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:20.874680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:20.875294 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:20.876760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1370/2728] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:20 2022] DELETE /identity/v3/projects/978e1b930d4243c08238d460ddc406c9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:20.880778 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5237-b5ec-465f-8111-fee59b2d02d0 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:20.890243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5237-b5ec-465f-8111-fee59b2d02d0 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:20.945081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:20.945729 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:20.946002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:20.946268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] PATH_INFO: `/v3/users/07bdb7a7e33b4a82b1440ed338d47d07` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:20.947350 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07bdb7a7e33b4a82b1440ed338d47d07)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:20.949336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:21.183519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07bdb7a7e33b4a82b1440ed338d47d07'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:21.191339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07bdb7a7e33b4a82b1440ed338d47d07'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:21.206951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07bdb7a7e33b4a82b1440ed338d47d07'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:21.207796 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07bdb7a7e33b4a82b1440ed338d47d07'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:21.208398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-51023756-0a73-434f-b62d-adf5ee36d867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07bdb7a7e33b4a82b1440ed338d47d07'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:21.277825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1359/2729] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:20 2022] DELETE /identity/v3/users/07bdb7a7e33b4a82b1440ed338d47d07 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:21.707717 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:21.709264 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:21.722859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6f5e-9947-4091-b823-f36642224558 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:21.779263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:21.779879 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:21.780178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:21.780447 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] PATH_INFO: `/v3/projects/0caad4de4cb04004a4c8a3701104edbf` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:21.781566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0caad4de4cb04004a4c8a3701104edbf)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:21.783475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:21.784889 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:21.912440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0caad4de4cb04004a4c8a3701104edbf', 'request_id': 'req-5ee704cd-55b9-4e65-9d91-bff5c85e8338'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:21.918546 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0caad4de4cb04004a4c8a3701104edbf', 'request_id': 'req-5ee704cd-55b9-4e65-9d91-bff5c85e8338'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:21.977731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0caad4de4cb04004a4c8a3701104edbf', 'request_id': 'req-5ee704cd-55b9-4e65-9d91-bff5c85e8338'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:21.988589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] The token cache is being invalidate because project 0caad4de4cb04004a4c8a3701104edbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:21.988875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:21.989527 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5ee704cd-55b9-4e65-9d91-bff5c85e8338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:21.991051 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1371/2730] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:21 2022] DELETE /identity/v3/projects/0caad4de4cb04004a4c8a3701104edbf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:21.996650 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b4dd-2eb7-4d37-bc44-b71329ac3e26 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:21.997145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b4dd-2eb7-4d37-bc44-b71329ac3e26 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:21.997272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9b4dd-2eb7-4d37-bc44-b71329ac3e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.016240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-16b9b4dd-2eb7-4d37-bc44-b71329ac3e26 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:22.017493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-16b9b4dd-2eb7-4d37-bc44-b71329ac3e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:22.050448 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:22.075435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1360/2731] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:22.083047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50428e5-a067-4d14-a440-b5412ddd570e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:22.083324 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50428e5-a067-4d14-a440-b5412ddd570e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:22.083589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50428e5-a067-4d14-a440-b5412ddd570e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.102847 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f50428e5-a067-4d14-a440-b5412ddd570e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:22.104518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f50428e5-a067-4d14-a440-b5412ddd570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:22.112256 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1372/2732] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:22.116436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9b4dd-2eb7-4d37-bc44-b71329ac3e26 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:22.126251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9b4dd-2eb7-4d37-bc44-b71329ac3e26 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:22.130836 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92663306-3596-4fdb-9e08-499370598c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:22.131414 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92663306-3596-4fdb-9e08-499370598c68 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:22.131686 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92663306-3596-4fdb-9e08-499370598c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:22.131953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92663306-3596-4fdb-9e08-499370598c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.132632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92663306-3596-4fdb-9e08-499370598c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:11:22.132928 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92663306-3596-4fdb-9e08-499370598c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:22.134552 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92663306-3596-4fdb-9e08-499370598c68 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:22.149335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1361/2733] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:11:22.150557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50428e5-a067-4d14-a440-b5412ddd570e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:22.160648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50428e5-a067-4d14-a440-b5412ddd570e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:22.165280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1445-5b8b-4f17-93ad-99582ba3eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:22.165851 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1445-5b8b-4f17-93ad-99582ba3eafa admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:22.166125 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1445-5b8b-4f17-93ad-99582ba3eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:22.166901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1445-5b8b-4f17-93ad-99582ba3eafa admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.167505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e1445-5b8b-4f17-93ad-99582ba3eafa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:22.169397 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e1445-5b8b-4f17-93ad-99582ba3eafa admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:22.257213 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1373/2734] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:22 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:11:22.258339 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92663306-3596-4fdb-9e08-499370598c68 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:22.268566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92663306-3596-4fdb-9e08-499370598c68 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:22.328091 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5840de-0b6d-4363-926c-16f688fe5805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:22.328689 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5840de-0b6d-4363-926c-16f688fe5805 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:22.328961 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5840de-0b6d-4363-926c-16f688fe5805 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:22.329223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5840de-0b6d-4363-926c-16f688fe5805 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.329871 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5840de-0b6d-4363-926c-16f688fe5805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:22.331739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5840de-0b6d-4363-926c-16f688fe5805 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:22.424017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1362/2735] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:22 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:11:22.428093 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1445-5b8b-4f17-93ad-99582ba3eafa admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:22.438275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1445-5b8b-4f17-93ad-99582ba3eafa admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:22.442937 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4587ca-2668-47ad-a338-8dabbc92a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:22.443519 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4587ca-2668-47ad-a338-8dabbc92a96d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:22.443793 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4587ca-2668-47ad-a338-8dabbc92a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:22.444063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4587ca-2668-47ad-a338-8dabbc92a96d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.444687 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4587ca-2668-47ad-a338-8dabbc92a96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:22.446371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4587ca-2668-47ad-a338-8dabbc92a96d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:22.456008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1374/2736] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:22.459775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5840de-0b6d-4363-926c-16f688fe5805 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:22.470136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5840de-0b6d-4363-926c-16f688fe5805 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:22.475119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6e82f-3433-43fb-b117-745f918ec697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:22.475710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6e82f-3433-43fb-b117-745f918ec697 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:22.475982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6e82f-3433-43fb-b117-745f918ec697 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:22.476245 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6e82f-3433-43fb-b117-745f918ec697 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.476867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6e82f-3433-43fb-b117-745f918ec697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:22.478464 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6e82f-3433-43fb-b117-745f918ec697 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:22.489626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1363/2737] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:22.493444 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4587ca-2668-47ad-a338-8dabbc92a96d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:22.503192 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4587ca-2668-47ad-a338-8dabbc92a96d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:22.507734 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89acd2-3088-4259-87a3-e4d80ea64262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:22.508359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89acd2-3088-4259-87a3-e4d80ea64262 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:22.508635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89acd2-3088-4259-87a3-e4d80ea64262 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:22.508906 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89acd2-3088-4259-87a3-e4d80ea64262 admin admin] PATH_INFO: `/v3/projects/3b7a284450d54c958fa7cbeedd66702f/users/71787b5a44d54ff9b4c218b0ead15715/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.522849 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89acd2-3088-4259-87a3-e4d80ea64262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7a284450d54c958fa7cbeedd66702f, user_id=71787b5a44d54ff9b4c218b0ead15715, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:22.525479 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89acd2-3088-4259-87a3-e4d80ea64262 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:22.624050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1375/2738] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:22 2022] PUT /identity/v3/projects/3b7a284450d54c958fa7cbeedd66702f/users/71787b5a44d54ff9b4c218b0ead15715/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:22.634543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b0275-24ee-4c40-9f34-1f7f3d133118 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:22.634833 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b0275-24ee-4c40-9f34-1f7f3d133118 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:22.635102 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b0275-24ee-4c40-9f34-1f7f3d133118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.664175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-246b0275-24ee-4c40-9f34-1f7f3d133118 None None] MFA Rules not processed for user `71787b5a44d54ff9b4c218b0ead15715`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:22.665388 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-246b0275-24ee-4c40-9f34-1f7f3d133118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:22.728654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1364/2739] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:22.733710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89acd2-3088-4259-87a3-e4d80ea64262 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:22.794468 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89acd2-3088-4259-87a3-e4d80ea64262 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:22.799114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8412e-36dc-40d5-9e83-f20ca94ac9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:22.799760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8412e-36dc-40d5-9e83-f20ca94ac9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:22.800034 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8412e-36dc-40d5-9e83-f20ca94ac9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:22.800302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8412e-36dc-40d5-9e83-f20ca94ac9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.800978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8412e-36dc-40d5-9e83-f20ca94ac9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:22.802893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8412e-36dc-40d5-9e83-f20ca94ac9d7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:22.877884 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1376/2740] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:22 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:22.882017 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b0275-24ee-4c40-9f34-1f7f3d133118 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:22.893144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b0275-24ee-4c40-9f34-1f7f3d133118 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:22.925255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:22.948697 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65740c0-775a-4c87-8357-86d1c34cc267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:22.949537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65740c0-775a-4c87-8357-86d1c34cc267 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:22.949812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65740c0-775a-4c87-8357-86d1c34cc267 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:22.950077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65740c0-775a-4c87-8357-86d1c34cc267 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:22.950693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65740c0-775a-4c87-8357-86d1c34cc267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:22.952576 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65740c0-775a-4c87-8357-86d1c34cc267 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:23.035315 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1365/2741] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:22 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:23.039455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8412e-36dc-40d5-9e83-f20ca94ac9d7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:23.049982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8412e-36dc-40d5-9e83-f20ca94ac9d7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:23.054852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630308ff-f342-475a-be82-b2078282359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:23.055456 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630308ff-f342-475a-be82-b2078282359e admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.055735 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630308ff-f342-475a-be82-b2078282359e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.056009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630308ff-f342-475a-be82-b2078282359e admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:23.056642 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630308ff-f342-475a-be82-b2078282359e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:23.058286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630308ff-f342-475a-be82-b2078282359e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:23.063838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:23.069210 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1377/2742] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:23.073780 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65740c0-775a-4c87-8357-86d1c34cc267 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:23.083825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65740c0-775a-4c87-8357-86d1c34cc267 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:23.089015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5bc03-5642-4a46-85cd-744faaec37e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:23.089635 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5bc03-5642-4a46-85cd-744faaec37e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.089910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5bc03-5642-4a46-85cd-744faaec37e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.094451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5bc03-5642-4a46-85cd-744faaec37e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:23.094451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5bc03-5642-4a46-85cd-744faaec37e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:23.094451 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5bc03-5642-4a46-85cd-744faaec37e8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:23.102912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1366/2743] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:23.107230 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630308ff-f342-475a-be82-b2078282359e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:23.118043 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630308ff-f342-475a-be82-b2078282359e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:23.123159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0bb5a-89a4-427e-bcee-65417515d8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:23.123859 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0bb5a-89a4-427e-bcee-65417515d8f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.129843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0bb5a-89a4-427e-bcee-65417515d8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.129843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0bb5a-89a4-427e-bcee-65417515d8f6 admin admin] PATH_INFO: `/v3/projects/19aba4743a4841d8ba45dea8293e5383/users/891d422d910b4886adc35065983c7be4/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:23.139605 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0bb5a-89a4-427e-bcee-65417515d8f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19aba4743a4841d8ba45dea8293e5383, user_id=891d422d910b4886adc35065983c7be4, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:23.142443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0bb5a-89a4-427e-bcee-65417515d8f6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:23.214450 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1378/2744] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:23 2022] PUT /identity/v3/projects/19aba4743a4841d8ba45dea8293e5383/users/891d422d910b4886adc35065983c7be4/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:23.226119 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822997-ed19-4f22-90e8-322c5a73a65e None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.226486 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822997-ed19-4f22-90e8-322c5a73a65e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.226756 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822997-ed19-4f22-90e8-322c5a73a65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:23.254938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-6a822997-ed19-4f22-90e8-322c5a73a65e None None] MFA Rules not processed for user `891d422d910b4886adc35065983c7be4`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:23.256172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6a822997-ed19-4f22-90e8-322c5a73a65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:23.321934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1367/2745] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:23.327076 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0bb5a-89a4-427e-bcee-65417515d8f6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:23.388683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0bb5a-89a4-427e-bcee-65417515d8f6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:23.393587 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd17902-e0cd-4b82-aac9-685e853c55da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:23.394339 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd17902-e0cd-4b82-aac9-685e853c55da admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.394716 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd17902-e0cd-4b82-aac9-685e853c55da admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.395086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd17902-e0cd-4b82-aac9-685e853c55da admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:23.395808 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd17902-e0cd-4b82-aac9-685e853c55da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:23.398167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd17902-e0cd-4b82-aac9-685e853c55da admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:23.515210 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1379/2746] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:23 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:23.519782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822997-ed19-4f22-90e8-322c5a73a65e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:23.533507 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822997-ed19-4f22-90e8-322c5a73a65e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:23.607617 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a3d8a-857d-43ac-a0e0-68dd97cfad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:23.608352 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a3d8a-857d-43ac-a0e0-68dd97cfad25 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.608648 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a3d8a-857d-43ac-a0e0-68dd97cfad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.608899 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a3d8a-857d-43ac-a0e0-68dd97cfad25 admin admin] PATH_INFO: `/v3/users` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:23.609554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a3d8a-857d-43ac-a0e0-68dd97cfad25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:23.611468 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a3d8a-857d-43ac-a0e0-68dd97cfad25 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:23.704629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1368/2747] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:23 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:23.705896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd17902-e0cd-4b82-aac9-685e853c55da admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:23.716994 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd17902-e0cd-4b82-aac9-685e853c55da admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:23.721878 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e0118-7ba9-4e90-9ff2-db91f3d8d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:23.722478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e0118-7ba9-4e90-9ff2-db91f3d8d01e admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.722751 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e0118-7ba9-4e90-9ff2-db91f3d8d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.723024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e0118-7ba9-4e90-9ff2-db91f3d8d01e admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:23.723658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e0118-7ba9-4e90-9ff2-db91f3d8d01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:23.725240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e0118-7ba9-4e90-9ff2-db91f3d8d01e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:23.736250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1380/2748] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:23.740236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a3d8a-857d-43ac-a0e0-68dd97cfad25 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:23.751388 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a3d8a-857d-43ac-a0e0-68dd97cfad25 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:23.755984 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8fd10-cdfa-4bce-908e-e373d9aa2e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:23.757929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8fd10-cdfa-4bce-908e-e373d9aa2e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.757929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8fd10-cdfa-4bce-908e-e373d9aa2e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.757929 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8fd10-cdfa-4bce-908e-e373d9aa2e94 admin admin] PATH_INFO: `/v3/projects/581d8cc9df5f40a7be56fe50af8fbb35/users/7f91d6653fda48709d8d7ce482631f29/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:23.773124 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8fd10-cdfa-4bce-908e-e373d9aa2e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581d8cc9df5f40a7be56fe50af8fbb35, user_id=7f91d6653fda48709d8d7ce482631f29, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:23.776378 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8fd10-cdfa-4bce-908e-e373d9aa2e94 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:23.846427 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1369/2749] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:23 2022] PUT /identity/v3/projects/581d8cc9df5f40a7be56fe50af8fbb35/users/7f91d6653fda48709d8d7ce482631f29/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:23.850505 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e0118-7ba9-4e90-9ff2-db91f3d8d01e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:23.860181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e0118-7ba9-4e90-9ff2-db91f3d8d01e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:23.921246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7411a-c592-426d-961d-b2269d1ec412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:23.921883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7411a-c592-426d-961d-b2269d1ec412 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.922157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7411a-c592-426d-961d-b2269d1ec412 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.922426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7411a-c592-426d-961d-b2269d1ec412 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:23.923092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7411a-c592-426d-961d-b2269d1ec412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:23.924661 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7411a-c592-426d-961d-b2269d1ec412 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:23.936909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1381/2750] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:23.941158 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8fd10-cdfa-4bce-908e-e373d9aa2e94 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:23.952510 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8fd10-cdfa-4bce-908e-e373d9aa2e94 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:23.957092 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc395c3-7a79-4632-bc35-fd7fa9b798c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:23.957775 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc395c3-7a79-4632-bc35-fd7fa9b798c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.958051 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc395c3-7a79-4632-bc35-fd7fa9b798c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.958319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc395c3-7a79-4632-bc35-fd7fa9b798c0 admin admin] PATH_INFO: `/v3/projects/581d8cc9df5f40a7be56fe50af8fbb35/users/7f91d6653fda48709d8d7ce482631f29/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:23.960221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc395c3-7a79-4632-bc35-fd7fa9b798c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581d8cc9df5f40a7be56fe50af8fbb35, user_id=7f91d6653fda48709d8d7ce482631f29, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:23.962869 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc395c3-7a79-4632-bc35-fd7fa9b798c0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:23.966006 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:23.974100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1370/2751] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:23 2022] PUT /identity/v3/projects/581d8cc9df5f40a7be56fe50af8fbb35/users/7f91d6653fda48709d8d7ce482631f29/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:23.987114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc916201-e58c-41a8-94a0-834293aa1f30 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:23.987403 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc916201-e58c-41a8-94a0-834293aa1f30 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:23.987677 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc916201-e58c-41a8-94a0-834293aa1f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:24.017398 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bc916201-e58c-41a8-94a0-834293aa1f30 None None] MFA Rules not processed for user `7f91d6653fda48709d8d7ce482631f29`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:24.018592 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bc916201-e58c-41a8-94a0-834293aa1f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:24.051333 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:24.086652 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1382/2752] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:24.097947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc395c3-7a79-4632-bc35-fd7fa9b798c0 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:24.099668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-dbc395c3-7a79-4632-bc35-fd7fa9b798c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:24.161967 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc395c3-7a79-4632-bc35-fd7fa9b798c0 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:24.166525 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b4878-7ddb-4feb-bf6d-8397d4ec33a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:24.167208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b4878-7ddb-4feb-bf6d-8397d4ec33a9 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:24.167809 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b4878-7ddb-4feb-bf6d-8397d4ec33a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:24.168230 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b4878-7ddb-4feb-bf6d-8397d4ec33a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:24.182719 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc916201-e58c-41a8-94a0-834293aa1f30 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:24.183034 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b4878-7ddb-4feb-bf6d-8397d4ec33a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:24.184298 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bc916201-e58c-41a8-94a0-834293aa1f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:24.184616 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b4878-7ddb-4feb-bf6d-8397d4ec33a9 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:24.196168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1371/2753] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:24.288763 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc916201-e58c-41a8-94a0-834293aa1f30 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:24.296025 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82242b73-98ca-4bca-8f44-5b7d30957fcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34568b830fc641edab39324047368546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:24.297280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242b73-98ca-4bca-8f44-5b7d30957fcd service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:24.297706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242b73-98ca-4bca-8f44-5b7d30957fcd service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:24.298040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242b73-98ca-4bca-8f44-5b7d30957fcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:24.302514 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-82242b73-98ca-4bca-8f44-5b7d30957fcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:24.318947 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82242b73-98ca-4bca-8f44-5b7d30957fcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:24.321094 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82242b73-98ca-4bca-8f44-5b7d30957fcd service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:24.334856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1383/2754] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:25.387417 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b4878-7ddb-4feb-bf6d-8397d4ec33a9 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:25.388845 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-f22b4878-7ddb-4feb-bf6d-8397d4ec33a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:25.399704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b4878-7ddb-4feb-bf6d-8397d4ec33a9 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:25.403514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d4733-8481-416d-b4b8-ca09386c1bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:25.404170 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4733-8481-416d-b4b8-ca09386c1bbd service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:25.404513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4733-8481-416d-b4b8-ca09386c1bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:25.404791 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d4733-8481-416d-b4b8-ca09386c1bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:25.460132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d4733-8481-416d-b4b8-ca09386c1bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:25.461597 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d4733-8481-416d-b4b8-ca09386c1bbd service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:25.470243 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1372/2755] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:30.329803 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82242b73-98ca-4bca-8f44-5b7d30957fcd service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:30.338867 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82242b73-98ca-4bca-8f44-5b7d30957fcd service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:30.342448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb065-9689-434d-9f28-a618c0663ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:30.343030 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb065-9689-434d-9f28-a618c0663ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:30.343302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb065-9689-434d-9f28-a618c0663ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:30.343568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eb065-9689-434d-9f28-a618c0663ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:30.398087 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183eb065-9689-434d-9f28-a618c0663ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:30.399493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183eb065-9689-434d-9f28-a618c0663ca2 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:30.407997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1384/2756] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:30.721307 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d4733-8481-416d-b4b8-ca09386c1bbd service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:30.723077 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1c8d4733-8481-416d-b4b8-ca09386c1bbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:30.781947 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d4733-8481-416d-b4b8-ca09386c1bbd service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:30.785520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e82f13-3231-4b63-a400-a43ec61d904e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:30.786120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e82f13-3231-4b63-a400-a43ec61d904e service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:30.786394 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e82f13-3231-4b63-a400-a43ec61d904e service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:30.786659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e82f13-3231-4b63-a400-a43ec61d904e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:30.788360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-08e82f13-3231-4b63-a400-a43ec61d904e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:30.835795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:30.850598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e82f13-3231-4b63-a400-a43ec61d904e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:30.852019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e82f13-3231-4b63-a400-a43ec61d904e service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:30.862294 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1373/2757] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:32.289965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb065-9689-434d-9f28-a618c0663ca2 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:32.300841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eb065-9689-434d-9f28-a618c0663ca2 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:32.305208 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c8edf-1b6e-48d8-b531-00996b125843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:32.305877 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c8edf-1b6e-48d8-b531-00996b125843 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:32.306152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c8edf-1b6e-48d8-b531-00996b125843 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:32.306464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c8edf-1b6e-48d8-b531-00996b125843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:32.308342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e68c8edf-1b6e-48d8-b531-00996b125843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:32.319062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c8edf-1b6e-48d8-b531-00996b125843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:32.320625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c8edf-1b6e-48d8-b531-00996b125843 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:32.330971 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1385/2758] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:34.303072 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e82f13-3231-4b63-a400-a43ec61d904e service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:34.315212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e82f13-3231-4b63-a400-a43ec61d904e service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:34.321009 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:34.321769 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:34.322172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:34.322506 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] PATH_INFO: `/v3/users/71787b5a44d54ff9b4c218b0ead15715` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:34.324286 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] RBAC: Authorizing `identity:delete_user(user_id=71787b5a44d54ff9b4c218b0ead15715)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:34.326357 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:34.524384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71787b5a44d54ff9b4c218b0ead15715'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:34.531939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71787b5a44d54ff9b4c218b0ead15715'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:34.544575 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71787b5a44d54ff9b4c218b0ead15715'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:34.545331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71787b5a44d54ff9b4c218b0ead15715'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:34.545935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71787b5a44d54ff9b4c218b0ead15715'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:34.697655 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1374/2759] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:34 2022] DELETE /identity/v3/users/71787b5a44d54ff9b4c218b0ead15715 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:34.704730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8315e-0c5a-45fe-9a50-e8aef276a903 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:34.705210 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8315e-0c5a-45fe-9a50-e8aef276a903 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:34.705342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8315e-0c5a-45fe-9a50-e8aef276a903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:34.724436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7dc8315e-0c5a-45fe-9a50-e8aef276a903 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:34.725643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7dc8315e-0c5a-45fe-9a50-e8aef276a903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:34.762903 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:34.782581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1386/2760] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:34.792963 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:34.798858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:34.833215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8315e-0c5a-45fe-9a50-e8aef276a903 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:34.834884 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7dc8315e-0c5a-45fe-9a50-e8aef276a903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:34.849841 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8315e-0c5a-45fe-9a50-e8aef276a903 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:34.855226 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:34.855853 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:34.856167 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:34.856523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] PATH_INFO: `/v3/users/4d58c48313b74f1685c99cb841e2646d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:34.857710 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d58c48313b74f1685c99cb841e2646d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:34.857862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925975a4-2466-4a34-992c-fff19289403e admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:34.859654 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:34.861316 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3177c-f663-4fcb-95c5-9c0e549faf99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:34.861923 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3177c-f663-4fcb-95c5-9c0e549faf99 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:34.862195 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3177c-f663-4fcb-95c5-9c0e549faf99 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:34.862456 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3177c-f663-4fcb-95c5-9c0e549faf99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:34.872271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3177c-f663-4fcb-95c5-9c0e549faf99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:34.873843 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3177c-f663-4fcb-95c5-9c0e549faf99 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:34.883187 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1375/2761] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:35.028226 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d58c48313b74f1685c99cb841e2646d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.040098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d58c48313b74f1685c99cb841e2646d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.040765 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d58c48313b74f1685c99cb841e2646d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.041399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d58c48313b74f1685c99cb841e2646d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.104131 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d58c48313b74f1685c99cb841e2646d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.118485 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1387/2762] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:34 2022] DELETE /identity/v3/users/4d58c48313b74f1685c99cb841e2646d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:35.297208 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3177c-f663-4fcb-95c5-9c0e549faf99 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:35.298668 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1fa3177c-f663-4fcb-95c5-9c0e549faf99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:35.311588 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3177c-f663-4fcb-95c5-9c0e549faf99 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:35.370589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:35.371214 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:35.371564 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:35.371810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] PATH_INFO: `/v3/projects/3b7a284450d54c958fa7cbeedd66702f` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:35.373261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7a284450d54c958fa7cbeedd66702f)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:35.377399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:35.377554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:35.377662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:35.377761 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:35.391104 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc09586-bed9-429c-be35-4e25fd01e0a5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:35.396363 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:35.397050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:35.397356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:35.397633 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] PATH_INFO: `/v3/projects/f08a6e1c369046158507b40700abb048` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:35.398754 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08a6e1c369046158507b40700abb048)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:35.400769 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:35.492126 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7a284450d54c958fa7cbeedd66702f', 'request_id': 'req-04e63c6e-b85a-46e5-bdd8-611631a343c0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.498397 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7a284450d54c958fa7cbeedd66702f', 'request_id': 'req-04e63c6e-b85a-46e5-bdd8-611631a343c0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.521056 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08a6e1c369046158507b40700abb048', 'request_id': 'req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.528111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08a6e1c369046158507b40700abb048', 'request_id': 'req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.589770 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7a284450d54c958fa7cbeedd66702f', 'request_id': 'req-04e63c6e-b85a-46e5-bdd8-611631a343c0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.600773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] The token cache is being invalidate because project 3b7a284450d54c958fa7cbeedd66702f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:35.601056 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.601679 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.603334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1376/2763] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:35 2022] DELETE /identity/v3/projects/3b7a284450d54c958fa7cbeedd66702f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:35.607272 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:35.608542 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:35.643451 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08a6e1c369046158507b40700abb048', 'request_id': 'req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.655621 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] The token cache is being invalidate because project f08a6e1c369046158507b40700abb048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:35.655962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.656589 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-68b8ed3b-e80a-4109-a1a9-b5bd25cbea22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.658152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1388/2764] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:35 2022] DELETE /identity/v3/projects/f08a6e1c369046158507b40700abb048 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:35.662782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220b54-7f7b-4339-bb10-3caab1181c9b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:35.663088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220b54-7f7b-4339-bb10-3caab1181c9b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:35.663354 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220b54-7f7b-4339-bb10-3caab1181c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:35.673965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e63c6e-b85a-46e5-bdd8-611631a343c0 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:35.683191 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c4220b54-7f7b-4339-bb10-3caab1181c9b None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:35.684394 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c4220b54-7f7b-4339-bb10-3caab1181c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:35.721190 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:35.749427 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:35.750144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:35.750491 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:35.750830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] PATH_INFO: `/v3/users/891d422d910b4886adc35065983c7be4` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:35.752129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=891d422d910b4886adc35065983c7be4)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:35.754145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:35.755054 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1389/2765] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:35.764481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597a456-834b-46c2-8371-fb3cfc098cea None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:35.764771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597a456-834b-46c2-8371-fb3cfc098cea None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:35.765029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597a456-834b-46c2-8371-fb3cfc098cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:35.786537 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7597a456-834b-46c2-8371-fb3cfc098cea None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:35.787825 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7597a456-834b-46c2-8371-fb3cfc098cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:35.796154 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1390/2766] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:35.800251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597a456-834b-46c2-8371-fb3cfc098cea None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:35.809510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597a456-834b-46c2-8371-fb3cfc098cea None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:35.813990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24393bf-264a-43e0-b7ea-b485d25bb5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:35.818221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24393bf-264a-43e0-b7ea-b485d25bb5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:35.818221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24393bf-264a-43e0-b7ea-b485d25bb5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:35.818221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24393bf-264a-43e0-b7ea-b485d25bb5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:35.818221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24393bf-264a-43e0-b7ea-b485d25bb5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:11:35.818221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24393bf-264a-43e0-b7ea-b485d25bb5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:35.818221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24393bf-264a-43e0-b7ea-b485d25bb5b8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:35.829230 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1391/2767] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:11:35.833369 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24393bf-264a-43e0-b7ea-b485d25bb5b8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:35.843258 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24393bf-264a-43e0-b7ea-b485d25bb5b8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:35.848062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1b25b-d154-4b9e-a5d5-23f1a2fa8a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:35.848629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1b25b-d154-4b9e-a5d5-23f1a2fa8a14 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:35.848905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1b25b-d154-4b9e-a5d5-23f1a2fa8a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:35.849176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1b25b-d154-4b9e-a5d5-23f1a2fa8a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:35.849800 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1b25b-d154-4b9e-a5d5-23f1a2fa8a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:35.851630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1b25b-d154-4b9e-a5d5-23f1a2fa8a14 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:35.929986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:35.935322 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891d422d910b4886adc35065983c7be4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.941904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891d422d910b4886adc35065983c7be4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.954185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891d422d910b4886adc35065983c7be4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.954867 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891d422d910b4886adc35065983c7be4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.955489 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891d422d910b4886adc35065983c7be4'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:35.958644 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1392/2768] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:35 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:11:35.962863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1b25b-d154-4b9e-a5d5-23f1a2fa8a14 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:35.964493 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-81f1b25b-d154-4b9e-a5d5-23f1a2fa8a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:36.024938 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1b25b-d154-4b9e-a5d5-23f1a2fa8a14 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:36.030029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202534-3481-4b01-ac9d-389c2c981236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:36.030646 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202534-3481-4b01-ac9d-389c2c981236 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.032351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202534-3481-4b01-ac9d-389c2c981236 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.032351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202534-3481-4b01-ac9d-389c2c981236 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.032351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40202534-3481-4b01-ac9d-389c2c981236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:36.033736 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40202534-3481-4b01-ac9d-389c2c981236 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:36.037986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1377/2769] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:35 2022] DELETE /identity/v3/users/891d422d910b4886adc35065983c7be4 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:36.122028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1393/2770] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:35 2022] POST /identity/v3/users => generated 303 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:11:36.126132 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:36.188125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6efa8f-e1e0-4a1e-86da-45851d8bc03c admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:36.192622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679d626-d7de-49e8-9518-becb7d179e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:36.193256 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679d626-d7de-49e8-9518-becb7d179e8a admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.193563 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679d626-d7de-49e8-9518-becb7d179e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.193834 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679d626-d7de-49e8-9518-becb7d179e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.194460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679d626-d7de-49e8-9518-becb7d179e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:36.196030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679d626-d7de-49e8-9518-becb7d179e8a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:36.206059 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1378/2771] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:36.210127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202534-3481-4b01-ac9d-389c2c981236 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:36.222430 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202534-3481-4b01-ac9d-389c2c981236 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:36.225572 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62960eb7-0d4d-4542-ab29-344034717461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:36.226286 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62960eb7-0d4d-4542-ab29-344034717461 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.226629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62960eb7-0d4d-4542-ab29-344034717461 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.226984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62960eb7-0d4d-4542-ab29-344034717461 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.227689 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62960eb7-0d4d-4542-ab29-344034717461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:36.229356 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62960eb7-0d4d-4542-ab29-344034717461 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:36.242063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1394/2772] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:36.244975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679d626-d7de-49e8-9518-becb7d179e8a admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:36.257404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679d626-d7de-49e8-9518-becb7d179e8a admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:36.262172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdea208-8ce2-45ca-9424-db101588ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:36.262888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdea208-8ce2-45ca-9424-db101588ca4f admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.263161 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdea208-8ce2-45ca-9424-db101588ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.263429 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdea208-8ce2-45ca-9424-db101588ca4f admin admin] PATH_INFO: `/v3/projects/a5d940f8e52e46c59aeb6c8fb4a30d74/users/6bc77d95d20d4a9b82314e3e3d4196ef/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.279970 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdea208-8ce2-45ca-9424-db101588ca4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d940f8e52e46c59aeb6c8fb4a30d74, user_id=6bc77d95d20d4a9b82314e3e3d4196ef, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:36.282639 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdea208-8ce2-45ca-9424-db101588ca4f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:36.349988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1379/2773] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:36 2022] PUT /identity/v3/projects/a5d940f8e52e46c59aeb6c8fb4a30d74/users/6bc77d95d20d4a9b82314e3e3d4196ef/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:36.362111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6149a-25bf-4d2b-9672-5051ec9f33ec None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.362392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6149a-25bf-4d2b-9672-5051ec9f33ec None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.362664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6149a-25bf-4d2b-9672-5051ec9f33ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.390276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-21b6149a-25bf-4d2b-9672-5051ec9f33ec None None] MFA Rules not processed for user `6bc77d95d20d4a9b82314e3e3d4196ef`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:36.391476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-21b6149a-25bf-4d2b-9672-5051ec9f33ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:36.448519 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdea208-8ce2-45ca-9424-db101588ca4f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:36.450319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-dcdea208-8ce2-45ca-9424-db101588ca4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:36.454725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1395/2774] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:11:36.463452 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6149a-25bf-4d2b-9672-5051ec9f33ec None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:36.469831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:36.523659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdea208-8ce2-45ca-9424-db101588ca4f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:36.528540 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:36.529240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.529533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6149a-25bf-4d2b-9672-5051ec9f33ec None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:36.529663 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.530007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] PATH_INFO: `/v3/projects/19aba4743a4841d8ba45dea8293e5383` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.531206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19aba4743a4841d8ba45dea8293e5383)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:36.533175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:36.534293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609adf2-81d0-4057-9608-7a1157e52dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:36.534886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609adf2-81d0-4057-9608-7a1157e52dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.535161 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609adf2-81d0-4057-9608-7a1157e52dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.535429 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609adf2-81d0-4057-9608-7a1157e52dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.536062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609adf2-81d0-4057-9608-7a1157e52dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:36.538611 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609adf2-81d0-4057-9608-7a1157e52dd1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:36.656182 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:36.657118 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1396/2775] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:36 2022] POST /identity/v3/projects => generated 403 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:36.661135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609adf2-81d0-4057-9608-7a1157e52dd1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:36.668678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19aba4743a4841d8ba45dea8293e5383', 'request_id': 'req-6177c772-2573-4983-913b-1b1655dbe28f'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:36.674915 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19aba4743a4841d8ba45dea8293e5383', 'request_id': 'req-6177c772-2573-4983-913b-1b1655dbe28f'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:36.721238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609adf2-81d0-4057-9608-7a1157e52dd1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:36.726210 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fcf03-4c81-4a59-9241-cfca3432976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:36.726807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fcf03-4c81-4a59-9241-cfca3432976b admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.727083 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fcf03-4c81-4a59-9241-cfca3432976b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.727359 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fcf03-4c81-4a59-9241-cfca3432976b admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.727999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fcf03-4c81-4a59-9241-cfca3432976b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:36.729953 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fcf03-4c81-4a59-9241-cfca3432976b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:36.769574 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19aba4743a4841d8ba45dea8293e5383', 'request_id': 'req-6177c772-2573-4983-913b-1b1655dbe28f'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:36.780865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] The token cache is being invalidate because project 19aba4743a4841d8ba45dea8293e5383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:36.781145 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:36.781904 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:36.783371 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1380/2776] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:36 2022] DELETE /identity/v3/projects/19aba4743a4841d8ba45dea8293e5383 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:36.787148 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:36.788409 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:36.820917 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1397/2777] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:36 2022] POST /identity/v3/users => generated 308 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:11:36.822135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fcf03-4c81-4a59-9241-cfca3432976b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:36.823733 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-190fcf03-4c81-4a59-9241-cfca3432976b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:36.835891 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fcf03-4c81-4a59-9241-cfca3432976b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:36.841550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89debb67-8118-4986-be56-290f26908eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:36.849600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89debb67-8118-4986-be56-290f26908eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.849600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89debb67-8118-4986-be56-290f26908eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.849600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89debb67-8118-4986-be56-290f26908eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.849600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89debb67-8118-4986-be56-290f26908eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:36.849600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89debb67-8118-4986-be56-290f26908eb7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:36.851798 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177c772-2573-4983-913b-1b1655dbe28f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:36.860052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1398/2778] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:36.860254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:36.860254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.860254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.860254 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] PATH_INFO: `/v3/users/7f91d6653fda48709d8d7ce482631f29` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.861694 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f91d6653fda48709d8d7ce482631f29)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:36.861818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89debb67-8118-4986-be56-290f26908eb7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:36.863781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:36.873144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89debb67-8118-4986-be56-290f26908eb7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:36.878020 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e83872-2733-4869-96df-d085597001fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:36.878701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83872-2733-4869-96df-d085597001fb admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:36.879028 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83872-2733-4869-96df-d085597001fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:36.879302 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83872-2733-4869-96df-d085597001fb admin admin] PATH_INFO: `/v3/projects/fe20f89224564d518caa9ee86af8f4ba/users/afaca363b9154d67af92587bc0e22f8c/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:36.894220 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e83872-2733-4869-96df-d085597001fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe20f89224564d518caa9ee86af8f4ba, user_id=afaca363b9154d67af92587bc0e22f8c, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:36.897066 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e83872-2733-4869-96df-d085597001fb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:36.992159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1399/2779] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:36 2022] PUT /identity/v3/projects/fe20f89224564d518caa9ee86af8f4ba/users/afaca363b9154d67af92587bc0e22f8c/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:36.996063 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e83872-2733-4869-96df-d085597001fb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:37.041155 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:37.056409 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e83872-2733-4869-96df-d085597001fb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:37.061072 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0289-a6c9-47fc-a11a-5b8cad6af39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:37.061698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0289-a6c9-47fc-a11a-5b8cad6af39e admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:37.066152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0289-a6c9-47fc-a11a-5b8cad6af39e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:37.066152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0289-a6c9-47fc-a11a-5b8cad6af39e admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:37.066152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd0289-a6c9-47fc-a11a-5b8cad6af39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:37.066152 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd0289-a6c9-47fc-a11a-5b8cad6af39e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:37.069521 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f91d6653fda48709d8d7ce482631f29'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.074749 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1400/2780] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:11:37.078723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0289-a6c9-47fc-a11a-5b8cad6af39e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:37.079908 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f91d6653fda48709d8d7ce482631f29'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.088037 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0289-a6c9-47fc-a11a-5b8cad6af39e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:37.092375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f91d6653fda48709d8d7ce482631f29'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.093063 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f91d6653fda48709d8d7ce482631f29'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.093392 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199e0c-36bd-492d-824b-762a67843dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:37.093905 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f91d6653fda48709d8d7ce482631f29'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.094019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199e0c-36bd-492d-824b-762a67843dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:37.094280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199e0c-36bd-492d-824b-762a67843dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:37.094551 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199e0c-36bd-492d-824b-762a67843dc9 admin admin] PATH_INFO: `/v3/projects/fe20f89224564d518caa9ee86af8f4ba/users/afaca363b9154d67af92587bc0e22f8c/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:37.096440 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199e0c-36bd-492d-824b-762a67843dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe20f89224564d518caa9ee86af8f4ba, user_id=afaca363b9154d67af92587bc0e22f8c, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:37.099341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199e0c-36bd-492d-824b-762a67843dc9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:37.109133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1401/2781] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:37 2022] PUT /identity/v3/projects/fe20f89224564d518caa9ee86af8f4ba/users/afaca363b9154d67af92587bc0e22f8c/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:37.118952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923618bb-f557-4e9c-be8c-96e040e4b0f2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:37.119233 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923618bb-f557-4e9c-be8c-96e040e4b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:37.119504 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923618bb-f557-4e9c-be8c-96e040e4b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:37.146111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-923618bb-f557-4e9c-be8c-96e040e4b0f2 None None] MFA Rules not processed for user `afaca363b9154d67af92587bc0e22f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:37.147293 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-923618bb-f557-4e9c-be8c-96e040e4b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:37.158002 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1381/2782] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:36 2022] DELETE /identity/v3/users/7f91d6653fda48709d8d7ce482631f29 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:37.236750 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1402/2783] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:37 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:11:37.248001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:37.249447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:37.294997 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:37.308050 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03878c93-c44c-49fb-9b08-b13855eb50a1 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:37.312353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd514d86-33e4-41f4-b673-a92d73e55cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:37.312939 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd514d86-33e4-41f4-b673-a92d73e55cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:37.313210 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd514d86-33e4-41f4-b673-a92d73e55cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:37.313496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd514d86-33e4-41f4-b673-a92d73e55cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:37.375993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd514d86-33e4-41f4-b673-a92d73e55cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:37.377642 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd514d86-33e4-41f4-b673-a92d73e55cb5 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:37.388064 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1382/2784] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:37 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:37.523457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923618bb-f557-4e9c-be8c-96e040e4b0f2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:37.525135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-923618bb-f557-4e9c-be8c-96e040e4b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:37.589860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923618bb-f557-4e9c-be8c-96e040e4b0f2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:37.594688 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd514d86-33e4-41f4-b673-a92d73e55cb5 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:37.594688 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-dd514d86-33e4-41f4-b673-a92d73e55cb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:37.654690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:37.655287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:37.655561 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:37.655833 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] PATH_INFO: `/v3/users/6bc77d95d20d4a9b82314e3e3d4196ef` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:37.657053 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc77d95d20d4a9b82314e3e3d4196ef)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:37.659006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:37.660576 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:37.661024 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd514d86-33e4-41f4-b673-a92d73e55cb5 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:37.665897 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:37.666675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:37.666943 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:37.667207 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] PATH_INFO: `/v3/projects/581d8cc9df5f40a7be56fe50af8fbb35` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:37.668917 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581d8cc9df5f40a7be56fe50af8fbb35)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:37.670982 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:37.848652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581d8cc9df5f40a7be56fe50af8fbb35', 'request_id': 'req-e07746f5-9d86-486f-8a20-7a9f965f2c15'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.848875 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc77d95d20d4a9b82314e3e3d4196ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.854839 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581d8cc9df5f40a7be56fe50af8fbb35', 'request_id': 'req-e07746f5-9d86-486f-8a20-7a9f965f2c15'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.862688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc77d95d20d4a9b82314e3e3d4196ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.863385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc77d95d20d4a9b82314e3e3d4196ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.863990 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc77d95d20d4a9b82314e3e3d4196ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.946270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581d8cc9df5f40a7be56fe50af8fbb35', 'request_id': 'req-e07746f5-9d86-486f-8a20-7a9f965f2c15'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.957007 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] The token cache is being invalidate because project 581d8cc9df5f40a7be56fe50af8fbb35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:37.957457 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.957962 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-e07746f5-9d86-486f-8a20-7a9f965f2c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:37.959442 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1383/2785] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:37 2022] DELETE /identity/v3/projects/581d8cc9df5f40a7be56fe50af8fbb35 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:37.965408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210356-6bbb-406f-bed4-9bef6ba23734 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:37.965715 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210356-6bbb-406f-bed4-9bef6ba23734 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:37.965985 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22210356-6bbb-406f-bed4-9bef6ba23734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:37.985755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-22210356-6bbb-406f-bed4-9bef6ba23734 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:37.986933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-22210356-6bbb-406f-bed4-9bef6ba23734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:38.000447 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:38.023436 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-39e23275-8a24-4913-bf3a-f88dc10d3740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc77d95d20d4a9b82314e3e3d4196ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:38.036438 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1403/2786] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:37 2022] DELETE /identity/v3/users/6bc77d95d20d4a9b82314e3e3d4196ef => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:38.040846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aba5d-803c-457c-9432-93bdebe971e7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.041239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aba5d-803c-457c-9432-93bdebe971e7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.041598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aba5d-803c-457c-9432-93bdebe971e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.045609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1384/2787] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:11:38.055192 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f71f-cbad-4955-8b66-243269f5c517 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.056887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f71f-cbad-4955-8b66-243269f5c517 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.056887 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4f71f-cbad-4955-8b66-243269f5c517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.062464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-775aba5d-803c-457c-9432-93bdebe971e7 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:38.063685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-775aba5d-803c-457c-9432-93bdebe971e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:38.076047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ebf4f71f-cbad-4955-8b66-243269f5c517 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:38.077216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ebf4f71f-cbad-4955-8b66-243269f5c517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:38.122628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1404/2788] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:11:38.132549 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aba5d-803c-457c-9432-93bdebe971e7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:38.133907 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-775aba5d-803c-457c-9432-93bdebe971e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:38.138162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1385/2789] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:11:38.142336 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4f71f-cbad-4955-8b66-243269f5c517 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:38.151183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4f71f-cbad-4955-8b66-243269f5c517 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:38.156514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe2882-7d08-4dfb-9c77-8967ef12a5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:38.157086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2882-7d08-4dfb-9c77-8967ef12a5dd admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.157386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2882-7d08-4dfb-9c77-8967ef12a5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.157654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe2882-7d08-4dfb-9c77-8967ef12a5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.158275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe2882-7d08-4dfb-9c77-8967ef12a5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:11:38.158581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe2882-7d08-4dfb-9c77-8967ef12a5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:38.160116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe2882-7d08-4dfb-9c77-8967ef12a5dd admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:38.172032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1386/2790] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:11:38.176238 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe2882-7d08-4dfb-9c77-8967ef12a5dd admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:38.186226 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe2882-7d08-4dfb-9c77-8967ef12a5dd admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:38.189827 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aba5d-803c-457c-9432-93bdebe971e7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:38.191032 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac8efd-6599-4bb5-8d27-1f5778d1f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:38.191609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac8efd-6599-4bb5-8d27-1f5778d1f3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.191882 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac8efd-6599-4bb5-8d27-1f5778d1f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.192150 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac8efd-6599-4bb5-8d27-1f5778d1f3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.192754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac8efd-6599-4bb5-8d27-1f5778d1f3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:38.193559 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaf9f7-52b1-4c49-a88d-37cd51ec7d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:38.194143 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf9f7-52b1-4c49-a88d-37cd51ec7d69 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.199475 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf9f7-52b1-4c49-a88d-37cd51ec7d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.199600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac8efd-6599-4bb5-8d27-1f5778d1f3c7 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:38.199692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf9f7-52b1-4c49-a88d-37cd51ec7d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.203535 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaf9f7-52b1-4c49-a88d-37cd51ec7d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:38.204996 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaf9f7-52b1-4c49-a88d-37cd51ec7d69 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:38.215130 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1405/2791] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:11:38.271054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1387/2792] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:38 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:11:38.272263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaf9f7-52b1-4c49-a88d-37cd51ec7d69 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:38.283003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaf9f7-52b1-4c49-a88d-37cd51ec7d69 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:38.303591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:38.343945 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac893962-2930-4409-a6c2-72b67eab55b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:38.344708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac893962-2930-4409-a6c2-72b67eab55b5 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.344983 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac893962-2930-4409-a6c2-72b67eab55b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.345279 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac893962-2930-4409-a6c2-72b67eab55b5 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.345978 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac893962-2930-4409-a6c2-72b67eab55b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:38.348382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac893962-2930-4409-a6c2-72b67eab55b5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:38.468985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1406/2793] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:38 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:38.471086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac8efd-6599-4bb5-8d27-1f5778d1f3c7 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:38.482408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac8efd-6599-4bb5-8d27-1f5778d1f3c7 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:38.486948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe5d83-6bcd-4b61-897e-52e9f3b1dd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:38.487682 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe5d83-6bcd-4b61-897e-52e9f3b1dd84 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.487922 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe5d83-6bcd-4b61-897e-52e9f3b1dd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.488212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe5d83-6bcd-4b61-897e-52e9f3b1dd84 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.488856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe5d83-6bcd-4b61-897e-52e9f3b1dd84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:38.490472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe5d83-6bcd-4b61-897e-52e9f3b1dd84 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:38.504255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1388/2794] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:38.508638 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac893962-2930-4409-a6c2-72b67eab55b5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:38.519236 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac893962-2930-4409-a6c2-72b67eab55b5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:38.523984 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe97d8c-1f34-4504-917d-e07a2b6f5cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:38.527806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe97d8c-1f34-4504-917d-e07a2b6f5cee admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.527806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe97d8c-1f34-4504-917d-e07a2b6f5cee admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.527806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe97d8c-1f34-4504-917d-e07a2b6f5cee admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.527806 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe97d8c-1f34-4504-917d-e07a2b6f5cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:38.528215 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe97d8c-1f34-4504-917d-e07a2b6f5cee admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:38.538382 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1407/2795] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:38.542646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe5d83-6bcd-4b61-897e-52e9f3b1dd84 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:38.553331 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe5d83-6bcd-4b61-897e-52e9f3b1dd84 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:38.560076 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bf015-c62a-4f50-bcf7-c5f60569955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:38.560729 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf015-c62a-4f50-bcf7-c5f60569955f admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.561008 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf015-c62a-4f50-bcf7-c5f60569955f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.561274 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf015-c62a-4f50-bcf7-c5f60569955f admin admin] PATH_INFO: `/v3/projects/98a086a6b2c44626912fbac0733615c0/users/896dbccff738432ba815b91712645d0d/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.580520 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bf015-c62a-4f50-bcf7-c5f60569955f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a086a6b2c44626912fbac0733615c0, user_id=896dbccff738432ba815b91712645d0d, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:38.583206 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bf015-c62a-4f50-bcf7-c5f60569955f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:38.657416 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1389/2796] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:38 2022] PUT /identity/v3/projects/98a086a6b2c44626912fbac0733615c0/users/896dbccff738432ba815b91712645d0d/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:38.659346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe97d8c-1f34-4504-917d-e07a2b6f5cee admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:38.661846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5fe97d8c-1f34-4504-917d-e07a2b6f5cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:38.678202 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba83b-db77-4d2a-b558-cc116abf37f6 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.678806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba83b-db77-4d2a-b558-cc116abf37f6 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.679376 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba83b-db77-4d2a-b558-cc116abf37f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.688449 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe97d8c-1f34-4504-917d-e07a2b6f5cee admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:38.717891 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-deeba83b-db77-4d2a-b558-cc116abf37f6 None None] MFA Rules not processed for user `896dbccff738432ba815b91712645d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:38.719116 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-deeba83b-db77-4d2a-b558-cc116abf37f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:38.751595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:38.752220 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.752498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.752770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] PATH_INFO: `/v3/projects/a5d940f8e52e46c59aeb6c8fb4a30d74` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.753950 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d940f8e52e46c59aeb6c8fb4a30d74)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:38.755858 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:38.763386 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:38.788380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1390/2797] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:11:38.800498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba83b-db77-4d2a-b558-cc116abf37f6 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:38.801951 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-deeba83b-db77-4d2a-b558-cc116abf37f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:38.864020 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba83b-db77-4d2a-b558-cc116abf37f6 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:38.880764 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d940f8e52e46c59aeb6c8fb4a30d74', 'request_id': 'req-a1028a4a-c70a-494b-b386-20690e8ecb30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:38.889915 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d940f8e52e46c59aeb6c8fb4a30d74', 'request_id': 'req-a1028a4a-c70a-494b-b386-20690e8ecb30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:38.919759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d77d3-f66c-4bb9-9c99-ba5a71137413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:38.920618 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d77d3-f66c-4bb9-9c99-ba5a71137413 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:38.920888 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d77d3-f66c-4bb9-9c99-ba5a71137413 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:38.921149 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d77d3-f66c-4bb9-9c99-ba5a71137413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:38.972278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d940f8e52e46c59aeb6c8fb4a30d74', 'request_id': 'req-a1028a4a-c70a-494b-b386-20690e8ecb30'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:38.983725 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] The token cache is being invalidate because project a5d940f8e52e46c59aeb6c8fb4a30d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:38.984007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:38.984743 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:38.984861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d77d3-f66c-4bb9-9c99-ba5a71137413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:38.986487 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d77d3-f66c-4bb9-9c99-ba5a71137413 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:38.986630 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1408/2798] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:38 2022] DELETE /identity/v3/projects/a5d940f8e52e46c59aeb6c8fb4a30d74 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:38.990249 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:38.991612 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:38.996949 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1391/2799] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:11:39.026986 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:39.060250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1028a4a-c70a-494b-b386-20690e8ecb30 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:39.067721 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:39.068496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:39.068772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:39.069050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] PATH_INFO: `/v3/users/afaca363b9154d67af92587bc0e22f8c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:39.070214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=afaca363b9154d67af92587bc0e22f8c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:39.072127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:39.282568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afaca363b9154d67af92587bc0e22f8c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:39.294701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afaca363b9154d67af92587bc0e22f8c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:39.295347 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afaca363b9154d67af92587bc0e22f8c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:39.296056 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afaca363b9154d67af92587bc0e22f8c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:39.366272 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-08f1bfb2-4ed9-466f-b43f-f876404e51fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afaca363b9154d67af92587bc0e22f8c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:39.379517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1409/2800] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:38 2022] DELETE /identity/v3/users/afaca363b9154d67af92587bc0e22f8c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:39.888781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d77d3-f66c-4bb9-9c99-ba5a71137413 service cinder] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:39.903788 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d77d3-f66c-4bb9-9c99-ba5a71137413 service cinder] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:39.955806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=100 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:39.966171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:39.966811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:39.967082 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:39.967347 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] PATH_INFO: `/v3/projects/fe20f89224564d518caa9ee86af8f4ba` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:39.968438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe20f89224564d518caa9ee86af8f4ba)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:39.970346 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:40.090384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe20f89224564d518caa9ee86af8f4ba', 'request_id': 'req-412def52-c0f2-49d3-a7af-d16f95905bfb'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:40.096458 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe20f89224564d518caa9ee86af8f4ba', 'request_id': 'req-412def52-c0f2-49d3-a7af-d16f95905bfb'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:40.177752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe20f89224564d518caa9ee86af8f4ba', 'request_id': 'req-412def52-c0f2-49d3-a7af-d16f95905bfb'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:40.189046 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] The token cache is being invalidate because project fe20f89224564d518caa9ee86af8f4ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:40.189356 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:40.189964 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-412def52-c0f2-49d3-a7af-d16f95905bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:40.191435 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1392/2801] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:39 2022] DELETE /identity/v3/projects/fe20f89224564d518caa9ee86af8f4ba => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:40.196268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1082d-4088-4e4f-bd64-90b717c16438 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:40.196774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1082d-4088-4e4f-bd64-90b717c16438 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:40.196883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1082d-4088-4e4f-bd64-90b717c16438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:40.215977 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-67e1082d-4088-4e4f-bd64-90b717c16438 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:40.217146 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-67e1082d-4088-4e4f-bd64-90b717c16438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:40.273565 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1410/2802] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:40.281675 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d198ad-7f56-4924-9070-b356b41d1eb8 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:40.281956 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d198ad-7f56-4924-9070-b356b41d1eb8 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:40.282220 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d198ad-7f56-4924-9070-b356b41d1eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:40.302129 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-36d198ad-7f56-4924-9070-b356b41d1eb8 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:40.303299 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-36d198ad-7f56-4924-9070-b356b41d1eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:40.311167 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1393/2803] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:40.315267 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1082d-4088-4e4f-bd64-90b717c16438 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:40.324740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1082d-4088-4e4f-bd64-90b717c16438 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:40.329246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee01b6-e4ce-4c49-a21e-be340b92920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:40.329860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee01b6-e4ce-4c49-a21e-be340b92920b admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:40.330137 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee01b6-e4ce-4c49-a21e-be340b92920b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:40.330406 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee01b6-e4ce-4c49-a21e-be340b92920b admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:40.331040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee01b6-e4ce-4c49-a21e-be340b92920b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:11:40.331342 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee01b6-e4ce-4c49-a21e-be340b92920b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:40.332922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee01b6-e4ce-4c49-a21e-be340b92920b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:40.344511 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1411/2804] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:11:40.348683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d198ad-7f56-4924-9070-b356b41d1eb8 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:40.358385 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d198ad-7f56-4924-9070-b356b41d1eb8 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:40.363103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ba039-edb9-48d0-8579-bdf8ee7f2ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:40.363680 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba039-edb9-48d0-8579-bdf8ee7f2ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:40.363953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba039-edb9-48d0-8579-bdf8ee7f2ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:40.364219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ba039-edb9-48d0-8579-bdf8ee7f2ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:40.364826 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ba039-edb9-48d0-8579-bdf8ee7f2ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:40.366763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ba039-edb9-48d0-8579-bdf8ee7f2ee8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:40.485078 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1394/2805] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:40 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:40.489268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee01b6-e4ce-4c49-a21e-be340b92920b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:40.500114 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee01b6-e4ce-4c49-a21e-be340b92920b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:40.533629 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:40.560405 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d88f4-a8bf-4cea-980e-7ab2f8653dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:40.561002 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d88f4-a8bf-4cea-980e-7ab2f8653dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:40.561275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d88f4-a8bf-4cea-980e-7ab2f8653dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:40.561571 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d88f4-a8bf-4cea-980e-7ab2f8653dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:40.562230 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d88f4-a8bf-4cea-980e-7ab2f8653dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:40.564178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d88f4-a8bf-4cea-980e-7ab2f8653dc3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:40.655351 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1412/2806] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:40 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:40.659224 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ba039-edb9-48d0-8579-bdf8ee7f2ee8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:40.669993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ba039-edb9-48d0-8579-bdf8ee7f2ee8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:40.674732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c57bf-ecb0-4a9b-bc75-dc04a1e99546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:40.675325 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c57bf-ecb0-4a9b-bc75-dc04a1e99546 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:40.675598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c57bf-ecb0-4a9b-bc75-dc04a1e99546 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:40.675868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c57bf-ecb0-4a9b-bc75-dc04a1e99546 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:40.676498 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c57bf-ecb0-4a9b-bc75-dc04a1e99546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:40.678113 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c57bf-ecb0-4a9b-bc75-dc04a1e99546 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:40.689334 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1395/2807] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:40.693401 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d88f4-a8bf-4cea-980e-7ab2f8653dc3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:40.703230 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d88f4-a8bf-4cea-980e-7ab2f8653dc3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:40.707802 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317cd0d-06c9-4d24-814b-324738c7ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:40.708389 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317cd0d-06c9-4d24-814b-324738c7ef27 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:40.708664 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317cd0d-06c9-4d24-814b-324738c7ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:40.708933 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317cd0d-06c9-4d24-814b-324738c7ef27 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:40.709593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317cd0d-06c9-4d24-814b-324738c7ef27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:40.711238 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317cd0d-06c9-4d24-814b-324738c7ef27 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:40.721375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1413/2808] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:40.725598 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c57bf-ecb0-4a9b-bc75-dc04a1e99546 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:40.736035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c57bf-ecb0-4a9b-bc75-dc04a1e99546 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:40.740669 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1352-a609-466c-a567-b9f3c2f4a384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:40.742261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1352-a609-466c-a567-b9f3c2f4a384 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:40.742261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1352-a609-466c-a567-b9f3c2f4a384 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:40.742261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1352-a609-466c-a567-b9f3c2f4a384 admin admin] PATH_INFO: `/v3/projects/926a15ace94c46d38454efadd72c4026/users/74e6134b08dc46de8e677478c0d5c54a/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:40.757168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1352-a609-466c-a567-b9f3c2f4a384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926a15ace94c46d38454efadd72c4026, user_id=74e6134b08dc46de8e677478c0d5c54a, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:40.760432 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1352-a609-466c-a567-b9f3c2f4a384 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:40.852690 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1396/2809] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:40 2022] PUT /identity/v3/projects/926a15ace94c46d38454efadd72c4026/users/74e6134b08dc46de8e677478c0d5c54a/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:40.864099 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d2f2a-40b1-46be-a53c-9bb1ca36b035 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:40.864509 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d2f2a-40b1-46be-a53c-9bb1ca36b035 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:40.864787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d2f2a-40b1-46be-a53c-9bb1ca36b035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:40.892047 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-900d2f2a-40b1-46be-a53c-9bb1ca36b035 None None] MFA Rules not processed for user `74e6134b08dc46de8e677478c0d5c54a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:40.893218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-900d2f2a-40b1-46be-a53c-9bb1ca36b035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:40.957055 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1414/2810] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:40.961601 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1352-a609-466c-a567-b9f3c2f4a384 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:41.021820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1352-a609-466c-a567-b9f3c2f4a384 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:41.026609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fc741-8345-45fc-bdde-d4f5e81cb350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:41.027236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fc741-8345-45fc-bdde-d4f5e81cb350 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:41.027511 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fc741-8345-45fc-bdde-d4f5e81cb350 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:41.027781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fc741-8345-45fc-bdde-d4f5e81cb350 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:41.028950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fc741-8345-45fc-bdde-d4f5e81cb350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:41.030854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fc741-8345-45fc-bdde-d4f5e81cb350 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:41.132612 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1397/2811] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:40 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:41.136649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d2f2a-40b1-46be-a53c-9bb1ca36b035 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:41.147856 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d2f2a-40b1-46be-a53c-9bb1ca36b035 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:41.207631 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de88075-2f4e-419f-8835-d0fcfcbdefa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:41.208514 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de88075-2f4e-419f-8835-d0fcfcbdefa5 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:41.208514 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de88075-2f4e-419f-8835-d0fcfcbdefa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:41.208848 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de88075-2f4e-419f-8835-d0fcfcbdefa5 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:41.209477 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de88075-2f4e-419f-8835-d0fcfcbdefa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:41.211431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de88075-2f4e-419f-8835-d0fcfcbdefa5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:41.326666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1415/2812] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:41 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:41.330514 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fc741-8345-45fc-bdde-d4f5e81cb350 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:41.335936 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:41.341818 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fc741-8345-45fc-bdde-d4f5e81cb350 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:41.346370 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22cd09-8a65-4c3f-94a2-cdef0080a7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:41.346959 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22cd09-8a65-4c3f-94a2-cdef0080a7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:41.347528 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22cd09-8a65-4c3f-94a2-cdef0080a7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:41.347759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22cd09-8a65-4c3f-94a2-cdef0080a7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:41.348388 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22cd09-8a65-4c3f-94a2-cdef0080a7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:41.349992 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22cd09-8a65-4c3f-94a2-cdef0080a7a2 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:41.361898 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1398/2813] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:41.366015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de88075-2f4e-419f-8835-d0fcfcbdefa5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:41.376133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de88075-2f4e-419f-8835-d0fcfcbdefa5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:41.380890 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da03dac-3eb2-46f3-a5b9-77467bdc4cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:41.381662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da03dac-3eb2-46f3-a5b9-77467bdc4cad admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:41.381935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da03dac-3eb2-46f3-a5b9-77467bdc4cad admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:41.382230 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da03dac-3eb2-46f3-a5b9-77467bdc4cad admin admin] PATH_INFO: `/v3/projects/970f587e265c436a8d860274f42a14a6/users/4b59399a64f140fca2ab0c01402d61c0/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:41.397948 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da03dac-3eb2-46f3-a5b9-77467bdc4cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=970f587e265c436a8d860274f42a14a6, user_id=4b59399a64f140fca2ab0c01402d61c0, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:41.400628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da03dac-3eb2-46f3-a5b9-77467bdc4cad admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:41.472658 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1416/2814] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:41 2022] PUT /identity/v3/projects/970f587e265c436a8d860274f42a14a6/users/4b59399a64f140fca2ab0c01402d61c0/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:41.476496 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22cd09-8a65-4c3f-94a2-cdef0080a7a2 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:41.487287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22cd09-8a65-4c3f-94a2-cdef0080a7a2 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:41.541318 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06a38c-418b-4bb2-9741-0c066a9acd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:41.541921 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06a38c-418b-4bb2-9741-0c066a9acd4a admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:41.542195 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06a38c-418b-4bb2-9741-0c066a9acd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:41.542463 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06a38c-418b-4bb2-9741-0c066a9acd4a admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:41.543081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06a38c-418b-4bb2-9741-0c066a9acd4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:41.545227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06a38c-418b-4bb2-9741-0c066a9acd4a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:41.555531 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1399/2815] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:41.560303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da03dac-3eb2-46f3-a5b9-77467bdc4cad admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:41.570523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da03dac-3eb2-46f3-a5b9-77467bdc4cad admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:41.575685 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd60be0-d1df-4512-b420-b872d59b746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:41.576314 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd60be0-d1df-4512-b420-b872d59b746d admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:41.576591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd60be0-d1df-4512-b420-b872d59b746d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:41.576909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd60be0-d1df-4512-b420-b872d59b746d admin admin] PATH_INFO: `/v3/projects/970f587e265c436a8d860274f42a14a6/users/4b59399a64f140fca2ab0c01402d61c0/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:41.578893 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd60be0-d1df-4512-b420-b872d59b746d admin admin] RBAC: Authorizing `identity:create_grant(project_id=970f587e265c436a8d860274f42a14a6, user_id=4b59399a64f140fca2ab0c01402d61c0, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:41.581531 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd60be0-d1df-4512-b420-b872d59b746d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:41.586836 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:41.592518 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1417/2816] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:41 2022] PUT /identity/v3/projects/970f587e265c436a8d860274f42a14a6/users/4b59399a64f140fca2ab0c01402d61c0/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:41.605754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec276160-604e-4b75-978c-57636098d431 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:41.606022 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec276160-604e-4b75-978c-57636098d431 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:41.606295 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec276160-604e-4b75-978c-57636098d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:41.633246 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-ec276160-604e-4b75-978c-57636098d431 None None] MFA Rules not processed for user `4b59399a64f140fca2ab0c01402d61c0`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:41.634465 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ec276160-604e-4b75-978c-57636098d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:41.702001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1400/2817] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:41.713515 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd60be0-d1df-4512-b420-b872d59b746d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:41.715218 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dbd60be0-d1df-4512-b420-b872d59b746d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:41.772974 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd60be0-d1df-4512-b420-b872d59b746d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:41.776785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d56ce-d216-48e0-9550-4b59afb0e1f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:41.777534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d56ce-d216-48e0-9550-4b59afb0e1f3 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:41.777897 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d56ce-d216-48e0-9550-4b59afb0e1f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:41.778686 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d56ce-d216-48e0-9550-4b59afb0e1f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:41.787492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d56ce-d216-48e0-9550-4b59afb0e1f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:41.788905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d56ce-d216-48e0-9550-4b59afb0e1f3 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:41.798221 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1418/2818] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:41.996437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec276160-604e-4b75-978c-57636098d431 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:42.006389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec276160-604e-4b75-978c-57636098d431 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:42.010136 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987b93e-7ad1-434e-a2b7-358afd15c50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:42.011060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987b93e-7ad1-434e-a2b7-358afd15c50e service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:42.011195 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987b93e-7ad1-434e-a2b7-358afd15c50e service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:42.011379 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987b93e-7ad1-434e-a2b7-358afd15c50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:42.067088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987b93e-7ad1-434e-a2b7-358afd15c50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:42.068497 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987b93e-7ad1-434e-a2b7-358afd15c50e service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:42.077935 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1401/2819] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:51.794110 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=27 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:52.073152 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=95 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:56.041760 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d56ce-d216-48e0-9550-4b59afb0e1f3 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:56.043176 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-225d56ce-d216-48e0-9550-4b59afb0e1f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:56.106843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d56ce-d216-48e0-9550-4b59afb0e1f3 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:56.111928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:56.112534 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:56.112804 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:56.113069 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] PATH_INFO: `/v3/users/896dbccff738432ba815b91712645d0d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:56.114209 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896dbccff738432ba815b91712645d0d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:56.116088 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:56.293036 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896dbccff738432ba815b91712645d0d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:56.305365 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896dbccff738432ba815b91712645d0d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:56.306042 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896dbccff738432ba815b91712645d0d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:56.306645 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896dbccff738432ba815b91712645d0d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:56.360168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896dbccff738432ba815b91712645d0d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:56.372244 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1419/2820] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:11:56 2022] DELETE /identity/v3/users/896dbccff738432ba815b91712645d0d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:56.377353 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a249b-7f00-4c11-a0ed-af13309bc21e None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:56.377832 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a249b-7f00-4c11-a0ed-af13309bc21e None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:56.377933 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a249b-7f00-4c11-a0ed-af13309bc21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:56.396652 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-9a9a249b-7f00-4c11-a0ed-af13309bc21e None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:56.397872 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9a9a249b-7f00-4c11-a0ed-af13309bc21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:56.457990 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1402/2821] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:56.468680 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:56.470124 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:56.526742 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515eafe-ac99-4d3d-a237-f156d42e2f96 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:56.530492 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60297c1-028d-482f-9690-f89f35ff1a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:56.531083 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60297c1-028d-482f-9690-f89f35ff1a33 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:56.531387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60297c1-028d-482f-9690-f89f35ff1a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:56.531655 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60297c1-028d-482f-9690-f89f35ff1a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:56.540824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60297c1-028d-482f-9690-f89f35ff1a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:56.542321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60297c1-028d-482f-9690-f89f35ff1a33 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:56.552701 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1420/2822] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:11:56.975566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a249b-7f00-4c11-a0ed-af13309bc21e None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:56.975566 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-9a9a249b-7f00-4c11-a0ed-af13309bc21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:56.988038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a249b-7f00-4c11-a0ed-af13309bc21e None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:56.993058 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:56.993846 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:56.994185 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:56.994548 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] PATH_INFO: `/v3/projects/98a086a6b2c44626912fbac0733615c0` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:56.995819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a086a6b2c44626912fbac0733615c0)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:56.998060 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:57.149474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a086a6b2c44626912fbac0733615c0', 'request_id': 'req-225d9902-41a2-41e1-987c-ef9486686375'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:57.156147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a086a6b2c44626912fbac0733615c0', 'request_id': 'req-225d9902-41a2-41e1-987c-ef9486686375'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:57.220415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a086a6b2c44626912fbac0733615c0', 'request_id': 'req-225d9902-41a2-41e1-987c-ef9486686375'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:57.231411 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] The token cache is being invalidate because project 98a086a6b2c44626912fbac0733615c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:11:57.231695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:57.232311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-225d9902-41a2-41e1-987c-ef9486686375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:11:57.235100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1403/2823] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:11:56 2022] DELETE /identity/v3/projects/98a086a6b2c44626912fbac0733615c0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:11:57.241706 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711f894-d89d-43c8-8bad-6839e73758eb None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:57.242231 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711f894-d89d-43c8-8bad-6839e73758eb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:57.242335 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711f894-d89d-43c8-8bad-6839e73758eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:57.262560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8711f894-d89d-43c8-8bad-6839e73758eb None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:57.263746 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8711f894-d89d-43c8-8bad-6839e73758eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:57.280186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:57.323741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1421/2824] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:11:57.331516 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845fa24-8343-43d9-ae65-6ea33ee22e50 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:57.331795 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845fa24-8343-43d9-ae65-6ea33ee22e50 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:57.332061 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845fa24-8343-43d9-ae65-6ea33ee22e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:57.351632 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-7845fa24-8343-43d9-ae65-6ea33ee22e50 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:57.352843 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-7845fa24-8343-43d9-ae65-6ea33ee22e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:57.361180 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1404/2825] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:57.365199 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711f894-d89d-43c8-8bad-6839e73758eb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:57.375292 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711f894-d89d-43c8-8bad-6839e73758eb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:57.379799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304adc95-ab13-4697-8a17-be1e88da91cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:57.380387 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304adc95-ab13-4697-8a17-be1e88da91cf admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:57.380661 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304adc95-ab13-4697-8a17-be1e88da91cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:57.380927 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304adc95-ab13-4697-8a17-be1e88da91cf admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:57.386767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304adc95-ab13-4697-8a17-be1e88da91cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:11:57.386767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304adc95-ab13-4697-8a17-be1e88da91cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:57.386767 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304adc95-ab13-4697-8a17-be1e88da91cf admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:57.404985 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1422/2826] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:11:57.408081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845fa24-8343-43d9-ae65-6ea33ee22e50 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:57.417937 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845fa24-8343-43d9-ae65-6ea33ee22e50 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:57.422884 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e6489-fe45-4fdd-abf5-f7b56ab45eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:57.423477 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e6489-fe45-4fdd-abf5-f7b56ab45eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:57.423755 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e6489-fe45-4fdd-abf5-f7b56ab45eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:57.424088 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e6489-fe45-4fdd-abf5-f7b56ab45eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:57.424702 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e6489-fe45-4fdd-abf5-f7b56ab45eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:57.426611 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e6489-fe45-4fdd-abf5-f7b56ab45eb6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:57.519225 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1405/2827] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:11:57 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:57.520569 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304adc95-ab13-4697-8a17-be1e88da91cf admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:57.530796 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304adc95-ab13-4697-8a17-be1e88da91cf admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:57.586908 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0cdfd-1d93-4f0e-9e4d-e76c53542967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:57.587489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0cdfd-1d93-4f0e-9e4d-e76c53542967 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:57.587771 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0cdfd-1d93-4f0e-9e4d-e76c53542967 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:57.588040 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0cdfd-1d93-4f0e-9e4d-e76c53542967 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:57.588674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0cdfd-1d93-4f0e-9e4d-e76c53542967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:57.590640 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0cdfd-1d93-4f0e-9e4d-e76c53542967 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:57.683604 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1423/2828] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:11:57 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:11:57.688266 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e6489-fe45-4fdd-abf5-f7b56ab45eb6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:57.698546 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e6489-fe45-4fdd-abf5-f7b56ab45eb6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:57.703912 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec33d3e-6131-48fd-a3c6-b92b5400d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:57.704500 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec33d3e-6131-48fd-a3c6-b92b5400d939 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:57.709383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec33d3e-6131-48fd-a3c6-b92b5400d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:57.709383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec33d3e-6131-48fd-a3c6-b92b5400d939 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:57.709383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec33d3e-6131-48fd-a3c6-b92b5400d939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:57.709383 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec33d3e-6131-48fd-a3c6-b92b5400d939 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:57.717270 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1406/2829] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:11:57.721134 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0cdfd-1d93-4f0e-9e4d-e76c53542967 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:57.731301 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0cdfd-1d93-4f0e-9e4d-e76c53542967 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:57.736029 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7687774-6841-4c48-bd09-8323c5ce9136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:57.736617 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7687774-6841-4c48-bd09-8323c5ce9136 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:57.736896 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7687774-6841-4c48-bd09-8323c5ce9136 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:57.737169 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7687774-6841-4c48-bd09-8323c5ce9136 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:57.737912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7687774-6841-4c48-bd09-8323c5ce9136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:57.739615 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7687774-6841-4c48-bd09-8323c5ce9136 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:57.750665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1424/2830] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:11:57.754719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec33d3e-6131-48fd-a3c6-b92b5400d939 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:57.765453 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec33d3e-6131-48fd-a3c6-b92b5400d939 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:57.770030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dbc8e-d577-4e3c-be20-5385d1ecf1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:57.770665 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dbc8e-d577-4e3c-be20-5385d1ecf1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:57.770944 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dbc8e-d577-4e3c-be20-5385d1ecf1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:57.771216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dbc8e-d577-4e3c-be20-5385d1ecf1c8 admin admin] PATH_INFO: `/v3/projects/e7c2d0c2974f4c7a92131bd3f8eeb41c/users/8ec51e67cc26432c8f8cc739456e8a3e/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:57.785651 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dbc8e-d577-4e3c-be20-5385d1ecf1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c2d0c2974f4c7a92131bd3f8eeb41c, user_id=8ec51e67cc26432c8f8cc739456e8a3e, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:57.788268 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dbc8e-d577-4e3c-be20-5385d1ecf1c8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:57.863856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1407/2831] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:11:57 2022] PUT /identity/v3/projects/e7c2d0c2974f4c7a92131bd3f8eeb41c/users/8ec51e67cc26432c8f8cc739456e8a3e/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:11:57.930265 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd56ca6-05e6-43fb-beaf-39f68a81ae43 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:57.930544 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd56ca6-05e6-43fb-beaf-39f68a81ae43 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:57.930812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd56ca6-05e6-43fb-beaf-39f68a81ae43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:57.957834 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ccd56ca6-05e6-43fb-beaf-39f68a81ae43 None None] MFA Rules not processed for user `8ec51e67cc26432c8f8cc739456e8a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:11:57.959010 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ccd56ca6-05e6-43fb-beaf-39f68a81ae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:58.020243 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1425/2832] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:11:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:11:58.032083 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dbc8e-d577-4e3c-be20-5385d1ecf1c8 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:11:58.033768 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-563dbc8e-d577-4e3c-be20-5385d1ecf1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:11:58.055919 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:58.092379 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dbc8e-d577-4e3c-be20-5385d1ecf1c8 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:11:58.096086 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a770894-ae98-4981-9c19-b48fb942bc00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e86be85010d4851a1ce3381832af230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:11:58.096710 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a770894-ae98-4981-9c19-b48fb942bc00 service glance] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:11:58.097255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a770894-ae98-4981-9c19-b48fb942bc00 service glance] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:11:58.097896 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a770894-ae98-4981-9c19-b48fb942bc00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:11:58.106577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a770894-ae98-4981-9c19-b48fb942bc00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:11:58.108550 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a770894-ae98-4981-9c19-b48fb942bc00 service glance] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:11:58.117251 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1408/2833] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:11:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:12:08.017319 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:08.238162 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=17 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:20.176775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd56ca6-05e6-43fb-beaf-39f68a81ae43 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:20.179098 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ccd56ca6-05e6-43fb-beaf-39f68a81ae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:20.247180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd56ca6-05e6-43fb-beaf-39f68a81ae43 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:20.251909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:20.252521 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:20.252795 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:20.253062 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] PATH_INFO: `/v3/users/74e6134b08dc46de8e677478c0d5c54a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:20.254275 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e6134b08dc46de8e677478c0d5c54a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:20.256175 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:20.433443 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e6134b08dc46de8e677478c0d5c54a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:20.445263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e6134b08dc46de8e677478c0d5c54a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:20.446008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e6134b08dc46de8e677478c0d5c54a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:20.446603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e6134b08dc46de8e677478c0d5c54a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:20.534692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e6134b08dc46de8e677478c0d5c54a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:20.548362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1426/2834] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:12:20 2022] DELETE /identity/v3/users/74e6134b08dc46de8e677478c0d5c54a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:20.553035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458540e-5f5d-440c-89b9-2cd40446ee08 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:20.553543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458540e-5f5d-440c-89b9-2cd40446ee08 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:20.554127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458540e-5f5d-440c-89b9-2cd40446ee08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:20.574287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-6458540e-5f5d-440c-89b9-2cd40446ee08 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:20.575462 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6458540e-5f5d-440c-89b9-2cd40446ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:20.634975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1409/2835] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:20.645460 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:20.650262 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:20.701703 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904eb0a-04bd-4083-ac45-30f3f1d3701b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:20.705240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2442f5b-b454-45de-b33e-382999d774ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:20.708039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2442f5b-b454-45de-b33e-382999d774ca service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:20.708039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2442f5b-b454-45de-b33e-382999d774ca service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:20.708039 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2442f5b-b454-45de-b33e-382999d774ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:20.715693 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2442f5b-b454-45de-b33e-382999d774ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:20.717092 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2442f5b-b454-45de-b33e-382999d774ca service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:20.726560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1427/2836] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:12:21.201047 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458540e-5f5d-440c-89b9-2cd40446ee08 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:21.201730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-6458540e-5f5d-440c-89b9-2cd40446ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:21.217609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458540e-5f5d-440c-89b9-2cd40446ee08 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:21.222774 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:21.227704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:21.227704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:21.227704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] PATH_INFO: `/v3/projects/926a15ace94c46d38454efadd72c4026` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:21.227704 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=926a15ace94c46d38454efadd72c4026)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:21.228396 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:21.360938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926a15ace94c46d38454efadd72c4026', 'request_id': 'req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:21.368288 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926a15ace94c46d38454efadd72c4026', 'request_id': 'req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:21.463398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926a15ace94c46d38454efadd72c4026', 'request_id': 'req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:21.474470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] The token cache is being invalidate because project 926a15ace94c46d38454efadd72c4026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:12:21.474764 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:21.475389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:21.476926 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1410/2837] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:12:21 2022] DELETE /identity/v3/projects/926a15ace94c46d38454efadd72c4026 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:21.481050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2442f5b-b454-45de-b33e-382999d774ca service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:21.490713 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2442f5b-b454-45de-b33e-382999d774ca service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:21.509034 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:21.550842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:21.551464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:21.551886 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:21.552160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] PATH_INFO: `/v3/users/4b59399a64f140fca2ab0c01402d61c0` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:21.553377 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b59399a64f140fca2ab0c01402d61c0)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:21.555336 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:21.768012 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b59399a64f140fca2ab0c01402d61c0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:21.779349 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b59399a64f140fca2ab0c01402d61c0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:21.780009 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b59399a64f140fca2ab0c01402d61c0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:21.780586 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b59399a64f140fca2ab0c01402d61c0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:21.871491 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc945fe4-fc8c-4f81-b1fc-71c68984af3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b59399a64f140fca2ab0c01402d61c0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:21.883773 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1428/2838] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:12:21 2022] DELETE /identity/v3/users/4b59399a64f140fca2ab0c01402d61c0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:22.305219 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:22.308120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:22.321200 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c825a80-92ff-42ce-97bf-69f6d61c3ff5 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:22.378975 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:22.379622 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:22.379894 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:22.380157 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] PATH_INFO: `/v3/projects/970f587e265c436a8d860274f42a14a6` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:22.381236 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=970f587e265c436a8d860274f42a14a6)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:22.383199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:22.470019 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:22.486375 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970f587e265c436a8d860274f42a14a6', 'request_id': 'req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:22.492374 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970f587e265c436a8d860274f42a14a6', 'request_id': 'req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:22.537700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970f587e265c436a8d860274f42a14a6', 'request_id': 'req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:22.556459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] The token cache is being invalidate because project 970f587e265c436a8d860274f42a14a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:12:22.556459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:22.556459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-d4c5b8f0-cf31-4730-9067-52ea6e70a3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:22.556459 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1411/2839] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:12:22 2022] DELETE /identity/v3/projects/970f587e265c436a8d860274f42a14a6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:22.557481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9f1ef-6a9c-4d62-bd3c-bf5977c8640c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:22.557481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9f1ef-6a9c-4d62-bd3c-bf5977c8640c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:22.557481 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9f1ef-6a9c-4d62-bd3c-bf5977c8640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:22.577391 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-94e9f1ef-6a9c-4d62-bd3c-bf5977c8640c None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:22.578588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-94e9f1ef-6a9c-4d62-bd3c-bf5977c8640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:22.641482 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1429/2840] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:22.649810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d6b9-2df7-46cd-ac5a-ccf2bc08fd77 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:22.650090 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d6b9-2df7-46cd-ac5a-ccf2bc08fd77 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:22.650490 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d6b9-2df7-46cd-ac5a-ccf2bc08fd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:22.670827 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-32d4d6b9-2df7-46cd-ac5a-ccf2bc08fd77 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:22.672012 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-32d4d6b9-2df7-46cd-ac5a-ccf2bc08fd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:22.680018 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1412/2841] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:22.684496 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9f1ef-6a9c-4d62-bd3c-bf5977c8640c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:22.693850 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9f1ef-6a9c-4d62-bd3c-bf5977c8640c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:22.698390 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe886691-7679-4b00-80b4-09762c65ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:22.698968 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe886691-7679-4b00-80b4-09762c65ecca admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:22.699240 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe886691-7679-4b00-80b4-09762c65ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:22.699507 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe886691-7679-4b00-80b4-09762c65ecca admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:22.700135 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe886691-7679-4b00-80b4-09762c65ecca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:12:22.700426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe886691-7679-4b00-80b4-09762c65ecca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:22.702156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe886691-7679-4b00-80b4-09762c65ecca admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:22.714683 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1430/2842] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:12:22.718825 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4d6b9-2df7-46cd-ac5a-ccf2bc08fd77 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:22.729165 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4d6b9-2df7-46cd-ac5a-ccf2bc08fd77 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:22.733911 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9ba7b-8740-45d1-8441-db86268234c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:22.734501 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9ba7b-8740-45d1-8441-db86268234c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:22.734773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9ba7b-8740-45d1-8441-db86268234c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:22.735037 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9ba7b-8740-45d1-8441-db86268234c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:22.735661 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9ba7b-8740-45d1-8441-db86268234c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:22.737567 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9ba7b-8740-45d1-8441-db86268234c6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:22.845965 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1413/2843] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:12:22 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:12:22.850237 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe886691-7679-4b00-80b4-09762c65ecca admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:22.862316 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe886691-7679-4b00-80b4-09762c65ecca admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:22.890140 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:22.924818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e934d-4a1b-4cc2-bf60-8ed3ed0d62cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:22.927785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e934d-4a1b-4cc2-bf60-8ed3ed0d62cc admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:22.927785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e934d-4a1b-4cc2-bf60-8ed3ed0d62cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:22.927785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e934d-4a1b-4cc2-bf60-8ed3ed0d62cc admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:22.927785 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e934d-4a1b-4cc2-bf60-8ed3ed0d62cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:22.928591 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e934d-4a1b-4cc2-bf60-8ed3ed0d62cc admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:23.014399 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1431/2844] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:12:22 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:12:23.018760 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9ba7b-8740-45d1-8441-db86268234c6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:23.029782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9ba7b-8740-45d1-8441-db86268234c6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:23.034408 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49637-449c-44e8-9ef7-337fb8b5bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:23.034991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49637-449c-44e8-9ef7-337fb8b5bf3f admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.035263 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49637-449c-44e8-9ef7-337fb8b5bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.035556 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49637-449c-44e8-9ef7-337fb8b5bf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.036267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d49637-449c-44e8-9ef7-337fb8b5bf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:23.037866 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d49637-449c-44e8-9ef7-337fb8b5bf3f admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:23.047532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1414/2845] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:12:23.051489 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e934d-4a1b-4cc2-bf60-8ed3ed0d62cc admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:23.061254 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e934d-4a1b-4cc2-bf60-8ed3ed0d62cc admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:23.065905 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aac615-e027-4f76-bd3c-fd64c5678817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:23.066490 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aac615-e027-4f76-bd3c-fd64c5678817 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.067311 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aac615-e027-4f76-bd3c-fd64c5678817 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.067625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aac615-e027-4f76-bd3c-fd64c5678817 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.068259 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aac615-e027-4f76-bd3c-fd64c5678817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:23.069895 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aac615-e027-4f76-bd3c-fd64c5678817 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:23.080400 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1432/2846] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:12:23.085218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49637-449c-44e8-9ef7-337fb8b5bf3f admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:23.095400 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49637-449c-44e8-9ef7-337fb8b5bf3f admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:23.100384 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c808b-cdb5-4ffa-aecf-0bbab784b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:23.101029 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c808b-cdb5-4ffa-aecf-0bbab784b76a admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.101321 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c808b-cdb5-4ffa-aecf-0bbab784b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.101609 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c808b-cdb5-4ffa-aecf-0bbab784b76a admin admin] PATH_INFO: `/v3/projects/dd54e701967e466fbfb6aef90aaf5bf6/users/27856c0fd52f4f8f826d5376befdf5cf/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.115953 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c808b-cdb5-4ffa-aecf-0bbab784b76a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd54e701967e466fbfb6aef90aaf5bf6, user_id=27856c0fd52f4f8f826d5376befdf5cf, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:23.118626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c808b-cdb5-4ffa-aecf-0bbab784b76a admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:23.209749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1415/2847] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:12:23 2022] PUT /identity/v3/projects/dd54e701967e466fbfb6aef90aaf5bf6/users/27856c0fd52f4f8f826d5376befdf5cf/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:12:23.220307 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997575e-d0e9-414a-a67b-5200e23cc6ef None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.220712 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997575e-d0e9-414a-a67b-5200e23cc6ef None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.221005 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997575e-d0e9-414a-a67b-5200e23cc6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.256235 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7997575e-d0e9-414a-a67b-5200e23cc6ef None None] MFA Rules not processed for user `27856c0fd52f4f8f826d5376befdf5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:23.257471 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7997575e-d0e9-414a-a67b-5200e23cc6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:23.327232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1433/2848] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:23.331865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c808b-cdb5-4ffa-aecf-0bbab784b76a admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:23.395739 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c808b-cdb5-4ffa-aecf-0bbab784b76a admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:23.400627 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9773c-2b43-41c4-bb6b-a68b749c7c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:23.401813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9773c-2b43-41c4-bb6b-a68b749c7c57 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.401813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9773c-2b43-41c4-bb6b-a68b749c7c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.401813 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9773c-2b43-41c4-bb6b-a68b749c7c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.402815 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9773c-2b43-41c4-bb6b-a68b749c7c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:23.404340 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9773c-2b43-41c4-bb6b-a68b749c7c57 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:23.498790 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1416/2849] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:12:23 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:12:23.502740 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997575e-d0e9-414a-a67b-5200e23cc6ef None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:23.513940 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997575e-d0e9-414a-a67b-5200e23cc6ef None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:23.569732 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0e8f9-c902-4e7f-9957-5c032e957978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:23.570381 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e8f9-c902-4e7f-9957-5c032e957978 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.570600 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e8f9-c902-4e7f-9957-5c032e957978 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.570866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e8f9-c902-4e7f-9957-5c032e957978 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.571480 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0e8f9-c902-4e7f-9957-5c032e957978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:23.573432 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0e8f9-c902-4e7f-9957-5c032e957978 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:23.652073 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1434/2850] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:12:23 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:12:23.655988 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9773c-2b43-41c4-bb6b-a68b749c7c57 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:23.666537 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9773c-2b43-41c4-bb6b-a68b749c7c57 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:23.671122 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d01b17-3b7d-4e79-8c0c-ccdbfce57092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:23.671707 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d01b17-3b7d-4e79-8c0c-ccdbfce57092 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.671981 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d01b17-3b7d-4e79-8c0c-ccdbfce57092 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.672248 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d01b17-3b7d-4e79-8c0c-ccdbfce57092 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.672877 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d01b17-3b7d-4e79-8c0c-ccdbfce57092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:23.674543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d01b17-3b7d-4e79-8c0c-ccdbfce57092 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:23.685492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1417/2851] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:12:23.689649 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0e8f9-c902-4e7f-9957-5c032e957978 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:23.699770 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0e8f9-c902-4e7f-9957-5c032e957978 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:23.706545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e556ee-bf37-4b38-8241-0b226aacefa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:23.707189 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e556ee-bf37-4b38-8241-0b226aacefa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.707464 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e556ee-bf37-4b38-8241-0b226aacefa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.709523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e556ee-bf37-4b38-8241-0b226aacefa2 admin admin] PATH_INFO: `/v3/projects/2d7f086355ad4f83886de02f5be6fa35/users/b010b8dce8be4219b69583852a9830cc/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.722448 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e556ee-bf37-4b38-8241-0b226aacefa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7f086355ad4f83886de02f5be6fa35, user_id=b010b8dce8be4219b69583852a9830cc, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:23.725609 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e556ee-bf37-4b38-8241-0b226aacefa2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:23.797554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1435/2852] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:12:23 2022] PUT /identity/v3/projects/2d7f086355ad4f83886de02f5be6fa35/users/b010b8dce8be4219b69583852a9830cc/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:23.802073 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d01b17-3b7d-4e79-8c0c-ccdbfce57092 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:23.811806 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d01b17-3b7d-4e79-8c0c-ccdbfce57092 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:23.831740 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:23.867262 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35246f59-4949-4067-b876-83c26a5cd99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:23.867858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35246f59-4949-4067-b876-83c26a5cd99e admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.868134 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35246f59-4949-4067-b876-83c26a5cd99e admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.868404 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35246f59-4949-4067-b876-83c26a5cd99e admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.869027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35246f59-4949-4067-b876-83c26a5cd99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:23.870638 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35246f59-4949-4067-b876-83c26a5cd99e admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:23.880144 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1418/2853] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:12:23.884327 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e556ee-bf37-4b38-8241-0b226aacefa2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:23.889728 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:23.895006 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e556ee-bf37-4b38-8241-0b226aacefa2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:23.899618 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba6276-ab34-4dd1-8d83-d1cac540214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:23.900283 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6276-ab34-4dd1-8d83-d1cac540214c admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.900554 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6276-ab34-4dd1-8d83-d1cac540214c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.900821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba6276-ab34-4dd1-8d83-d1cac540214c admin admin] PATH_INFO: `/v3/projects/2d7f086355ad4f83886de02f5be6fa35/users/b010b8dce8be4219b69583852a9830cc/roles/edba0d8c079245a38a321d2d77d25419` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.902775 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba6276-ab34-4dd1-8d83-d1cac540214c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7f086355ad4f83886de02f5be6fa35, user_id=b010b8dce8be4219b69583852a9830cc, role_id=edba0d8c079245a38a321d2d77d25419)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:23.905410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba6276-ab34-4dd1-8d83-d1cac540214c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:23.916341 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1436/2854] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:12:23 2022] PUT /identity/v3/projects/2d7f086355ad4f83886de02f5be6fa35/users/b010b8dce8be4219b69583852a9830cc/roles/edba0d8c079245a38a321d2d77d25419 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:23.928329 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137789-f57e-4da7-bf50-fe144c22274f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:23.928608 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137789-f57e-4da7-bf50-fe144c22274f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:23.928902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137789-f57e-4da7-bf50-fe144c22274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:23.957803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-c4137789-f57e-4da7-bf50-fe144c22274f None None] MFA Rules not processed for user `b010b8dce8be4219b69583852a9830cc`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:23.959103 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-c4137789-f57e-4da7-bf50-fe144c22274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:24.033890 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1419/2855] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:24.049214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba6276-ab34-4dd1-8d83-d1cac540214c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:24.050909 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-82ba6276-ab34-4dd1-8d83-d1cac540214c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:24.110064 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba6276-ab34-4dd1-8d83-d1cac540214c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:24.113916 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad47d4-a80b-45fe-af9e-6fb7c2878540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:24.114548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad47d4-a80b-45fe-af9e-6fb7c2878540 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:24.114821 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad47d4-a80b-45fe-af9e-6fb7c2878540 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:24.115090 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad47d4-a80b-45fe-af9e-6fb7c2878540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:24.125670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad47d4-a80b-45fe-af9e-6fb7c2878540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:24.127020 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad47d4-a80b-45fe-af9e-6fb7c2878540 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:24.138224 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1437/2856] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:12:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:12:25.271810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4137789-f57e-4da7-bf50-fe144c22274f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:25.335683 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4137789-f57e-4da7-bf50-fe144c22274f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:25.340237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:25.340854 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:25.341130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:25.341436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] PATH_INFO: `/v3/users/27856c0fd52f4f8f826d5376befdf5cf` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:25.342544 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27856c0fd52f4f8f826d5376befdf5cf)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:25.344449 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:25.537700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27856c0fd52f4f8f826d5376befdf5cf'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:25.538925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:25.545570 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27856c0fd52f4f8f826d5376befdf5cf'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:25.557509 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27856c0fd52f4f8f826d5376befdf5cf'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:25.558222 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27856c0fd52f4f8f826d5376befdf5cf'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:25.558816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27856c0fd52f4f8f826d5376befdf5cf'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:25.645474 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1420/2857] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:12:25 2022] DELETE /identity/v3/users/27856c0fd52f4f8f826d5376befdf5cf => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:25.650091 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869097a0-d356-4af5-b4fd-9bc429a1da23 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:25.650570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869097a0-d356-4af5-b4fd-9bc429a1da23 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:25.650684 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869097a0-d356-4af5-b4fd-9bc429a1da23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:25.669327 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-869097a0-d356-4af5-b4fd-9bc429a1da23 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:25.675461 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-869097a0-d356-4af5-b4fd-9bc429a1da23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:25.728557 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1438/2858] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:25.738287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:25.739763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:25.797372 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fb067-d0de-4ae0-8bd8-81eecc09a711 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:25.800980 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d61c0-6c55-4021-851e-0d65f15d2fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:25.801732 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d61c0-6c55-4021-851e-0d65f15d2fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:25.802003 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d61c0-6c55-4021-851e-0d65f15d2fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:25.802269 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d61c0-6c55-4021-851e-0d65f15d2fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:25.811074 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d61c0-6c55-4021-851e-0d65f15d2fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:25.812484 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d61c0-6c55-4021-851e-0d65f15d2fc4 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:25.822240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1421/2859] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:12:26.253375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869097a0-d356-4af5-b4fd-9bc429a1da23 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:26.255376 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-869097a0-d356-4af5-b4fd-9bc429a1da23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:26.267512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869097a0-d356-4af5-b4fd-9bc429a1da23 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:26.272579 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:26.274532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:26.274532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:26.274532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] PATH_INFO: `/v3/projects/dd54e701967e466fbfb6aef90aaf5bf6` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:26.275439 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd54e701967e466fbfb6aef90aaf5bf6)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:26.277532 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:26.377510 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd54e701967e466fbfb6aef90aaf5bf6', 'request_id': 'req-95ef6b64-d338-4167-aade-5b03c0f09878'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:26.384117 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd54e701967e466fbfb6aef90aaf5bf6', 'request_id': 'req-95ef6b64-d338-4167-aade-5b03c0f09878'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:26.451603 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd54e701967e466fbfb6aef90aaf5bf6', 'request_id': 'req-95ef6b64-d338-4167-aade-5b03c0f09878'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:26.463602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] The token cache is being invalidate because project dd54e701967e466fbfb6aef90aaf5bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:12:26.463956 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:26.464620 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:26.466185 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1439/2860] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:12:26 2022] DELETE /identity/v3/projects/dd54e701967e466fbfb6aef90aaf5bf6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:26.470590 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d61c0-6c55-4021-851e-0d65f15d2fc4 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:26.480284 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d61c0-6c55-4021-851e-0d65f15d2fc4 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:26.535554 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:26.536093 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:26.536361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:26.536626 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] PATH_INFO: `/v3/users/b010b8dce8be4219b69583852a9830cc` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:26.537838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b010b8dce8be4219b69583852a9830cc)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:26.539860 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:26.770901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b010b8dce8be4219b69583852a9830cc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:26.777906 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b010b8dce8be4219b69583852a9830cc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:26.789879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:26.790811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b010b8dce8be4219b69583852a9830cc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:26.791503 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b010b8dce8be4219b69583852a9830cc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:26.792104 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-2cc8360e-4ac1-4ace-99c5-694eee6c0203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b010b8dce8be4219b69583852a9830cc'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:26.859742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1422/2861] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:12:26 2022] DELETE /identity/v3/users/b010b8dce8be4219b69583852a9830cc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:27.267781 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:27.269241 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:27.287812 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef6b64-d338-4167-aade-5b03c0f09878 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:27.299756 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:27.345823 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:27.346375 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:27.346651 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:27.346922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] PATH_INFO: `/v3/projects/2d7f086355ad4f83886de02f5be6fa35` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:27.348278 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7f086355ad4f83886de02f5be6fa35)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:27.350349 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:27.444160 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7f086355ad4f83886de02f5be6fa35', 'request_id': 'req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:27.450268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7f086355ad4f83886de02f5be6fa35', 'request_id': 'req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:27.500142 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7f086355ad4f83886de02f5be6fa35', 'request_id': 'req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:27.510419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] The token cache is being invalidate because project 2d7f086355ad4f83886de02f5be6fa35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:12:27.510704 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:27.511303 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5bb287b-31ae-44f6-875e-1e74ab0f1e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:27.512741 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1440/2862] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:12:27 2022] DELETE /identity/v3/projects/2d7f086355ad4f83886de02f5be6fa35 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:27.517646 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0bfb2-14dc-4914-9b29-cda85e4d96a6 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:27.518105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0bfb2-14dc-4914-9b29-cda85e4d96a6 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:27.518217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0bfb2-14dc-4914-9b29-cda85e4d96a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:27.537838 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-35a0bfb2-14dc-4914-9b29-cda85e4d96a6 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:27.539031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-35a0bfb2-14dc-4914-9b29-cda85e4d96a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:27.598662 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1423/2863] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:27.606232 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680388-41a9-4ec7-aeac-8c0623c980a2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:27.606512 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680388-41a9-4ec7-aeac-8c0623c980a2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:27.606778 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680388-41a9-4ec7-aeac-8c0623c980a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:27.626676 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-96680388-41a9-4ec7-aeac-8c0623c980a2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:27.627840 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-96680388-41a9-4ec7-aeac-8c0623c980a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:27.635731 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1441/2864] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:27.639925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0bfb2-14dc-4914-9b29-cda85e4d96a6 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:27.649455 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0bfb2-14dc-4914-9b29-cda85e4d96a6 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:27.653991 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afc652-a0cf-47cf-a84b-0b60fd21ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:27.654582 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afc652-a0cf-47cf-a84b-0b60fd21ae2c admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:27.654858 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afc652-a0cf-47cf-a84b-0b60fd21ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:27.655130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afc652-a0cf-47cf-a84b-0b60fd21ae2c admin admin] PATH_INFO: `/v3/domains` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:27.655773 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afc652-a0cf-47cf-a84b-0b60fd21ae2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:12:27.656075 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afc652-a0cf-47cf-a84b-0b60fd21ae2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:27.657684 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afc652-a0cf-47cf-a84b-0b60fd21ae2c admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:27.669797 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1424/2865] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 23:12:27.674019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96680388-41a9-4ec7-aeac-8c0623c980a2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:27.683758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96680388-41a9-4ec7-aeac-8c0623c980a2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:27.688425 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1f493-98b4-43e2-b2ed-06bc2542d525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:27.689008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1f493-98b4-43e2-b2ed-06bc2542d525 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:27.689282 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1f493-98b4-43e2-b2ed-06bc2542d525 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:27.689650 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1f493-98b4-43e2-b2ed-06bc2542d525 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:27.690263 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1f493-98b4-43e2-b2ed-06bc2542d525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:27.692127 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1f493-98b4-43e2-b2ed-06bc2542d525 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:27.745893 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afc652-a0cf-47cf-a84b-0b60fd21ae2c admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:27.747589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-66afc652-a0cf-47cf-a84b-0b60fd21ae2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:27.760275 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afc652-a0cf-47cf-a84b-0b60fd21ae2c admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:27.764879 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:27.765523 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:27.765800 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:27.766070 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] PATH_INFO: `/v3/users/8ec51e67cc26432c8f8cc739456e8a3e` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:27.767173 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec51e67cc26432c8f8cc739456e8a3e)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:27.769054 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:27.791144 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1442/2866] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:12:27 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:12:27.795186 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1f493-98b4-43e2-b2ed-06bc2542d525 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:27.854116 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1f493-98b4-43e2-b2ed-06bc2542d525 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:27.858842 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f68002-291a-47d9-87d3-a11780fe085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:27.863466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f68002-291a-47d9-87d3-a11780fe085a admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:27.863466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f68002-291a-47d9-87d3-a11780fe085a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:27.863466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f68002-291a-47d9-87d3-a11780fe085a admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:27.863466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f68002-291a-47d9-87d3-a11780fe085a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:27.863466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f68002-291a-47d9-87d3-a11780fe085a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:27.959551 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec51e67cc26432c8f8cc739456e8a3e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:27.966216 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec51e67cc26432c8f8cc739456e8a3e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:27.976013 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1443/2867] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:12:27 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:12:27.979049 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec51e67cc26432c8f8cc739456e8a3e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:27.979763 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec51e67cc26432c8f8cc739456e8a3e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:27.980102 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f68002-291a-47d9-87d3-a11780fe085a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:27.980397 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc290609-e853-45df-a6c0-33a55a2d2151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec51e67cc26432c8f8cc739456e8a3e'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:27.981708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-55f68002-291a-47d9-87d3-a11780fe085a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:27.993862 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f68002-291a-47d9-87d3-a11780fe085a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:27.998411 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8609ae8-e603-4b04-a38b-9fd18cc67c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:27.998982 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8609ae8-e603-4b04-a38b-9fd18cc67c60 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:27.999255 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8609ae8-e603-4b04-a38b-9fd18cc67c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:27.999517 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8609ae8-e603-4b04-a38b-9fd18cc67c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:28.000132 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8609ae8-e603-4b04-a38b-9fd18cc67c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:28.001737 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8609ae8-e603-4b04-a38b-9fd18cc67c60 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:28.002928 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:28.012768 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1444/2868] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:12:28.016690 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8609ae8-e603-4b04-a38b-9fd18cc67c60 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:28.025885 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8609ae8-e603-4b04-a38b-9fd18cc67c60 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:28.030580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838235d7-9c42-478b-9275-a354e4e3198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:28.035564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838235d7-9c42-478b-9275-a354e4e3198a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:28.035564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838235d7-9c42-478b-9275-a354e4e3198a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:28.035564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838235d7-9c42-478b-9275-a354e4e3198a admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:28.035564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838235d7-9c42-478b-9275-a354e4e3198a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:28.035564 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838235d7-9c42-478b-9275-a354e4e3198a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:28.044082 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1445/2869] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:12:28.047810 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838235d7-9c42-478b-9275-a354e4e3198a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:28.057476 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838235d7-9c42-478b-9275-a354e4e3198a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:28.062182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ad7f8-9a4a-4f6e-a131-9f5298b35678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:28.064287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ad7f8-9a4a-4f6e-a131-9f5298b35678 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:28.064287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ad7f8-9a4a-4f6e-a131-9f5298b35678 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:28.064499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1425/2870] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:12:27 2022] DELETE /identity/v3/users/8ec51e67cc26432c8f8cc739456e8a3e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:12:28.064610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ad7f8-9a4a-4f6e-a131-9f5298b35678 admin admin] PATH_INFO: `/v3/projects/c41633408a774fa4abffb0a79a938679/users/1f0b384ac42043eabd486dd36eb02a79/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:28.068087 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf618e-d5f0-4488-aff0-3ea5cca86b3f None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:28.068536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf618e-d5f0-4488-aff0-3ea5cca86b3f None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:28.068811 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf618e-d5f0-4488-aff0-3ea5cca86b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:28.079242 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ad7f8-9a4a-4f6e-a131-9f5298b35678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41633408a774fa4abffb0a79a938679, user_id=1f0b384ac42043eabd486dd36eb02a79, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:28.081989 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ad7f8-9a4a-4f6e-a131-9f5298b35678 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:28.087287 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-4ccf618e-d5f0-4488-aff0-3ea5cca86b3f None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:28.088466 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4ccf618e-d5f0-4488-aff0-3ea5cca86b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:28.130499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:28.146183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1446/2871] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:12:28 2022] PUT /identity/v3/projects/c41633408a774fa4abffb0a79a938679/users/1f0b384ac42043eabd486dd36eb02a79/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 23:12:28.149724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1426/2872] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:28.156367 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc383-11df-4684-8156-db7b4ddf8954 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:28.156648 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc383-11df-4684-8156-db7b4ddf8954 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:28.156782 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf618e-d5f0-4488-aff0-3ea5cca86b3f None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:28.156918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cc383-11df-4684-8156-db7b4ddf8954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:28.158183 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4ccf618e-d5f0-4488-aff0-3ea5cca86b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:28.185548 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8a2cc383-11df-4684-8156-db7b4ddf8954 None None] MFA Rules not processed for user `1f0b384ac42043eabd486dd36eb02a79`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:28.186723 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8a2cc383-11df-4684-8156-db7b4ddf8954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:28.214038 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf618e-d5f0-4488-aff0-3ea5cca86b3f None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:28.251949 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1447/2873] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:28.262914 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cc383-11df-4684-8156-db7b4ddf8954 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:28.264268 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8a2cc383-11df-4684-8156-db7b4ddf8954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:28.266261 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37252f3-075e-4a41-a3b7-68e73bcd8e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:28.266865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37252f3-075e-4a41-a3b7-68e73bcd8e07 service neutron] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:28.267143 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37252f3-075e-4a41-a3b7-68e73bcd8e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:28.267415 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37252f3-075e-4a41-a3b7-68e73bcd8e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:28.319102 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cc383-11df-4684-8156-db7b4ddf8954 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:28.322670 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915270d6-609e-4a2c-af31-1178a6c18546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:28.323262 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915270d6-609e-4a2c-af31-1178a6c18546 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:28.323533 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915270d6-609e-4a2c-af31-1178a6c18546 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:28.323799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915270d6-609e-4a2c-af31-1178a6c18546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:28.327539 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37252f3-075e-4a41-a3b7-68e73bcd8e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:28.329445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37252f3-075e-4a41-a3b7-68e73bcd8e07 service neutron] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:28.331999 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915270d6-609e-4a2c-af31-1178a6c18546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:28.333528 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915270d6-609e-4a2c-af31-1178a6c18546 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:28.339297 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1427/2874] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:12:28.342602 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1448/2875] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:12:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 23:12:28.753097 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37252f3-075e-4a41-a3b7-68e73bcd8e07 service neutron] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:28.755296 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b37252f3-075e-4a41-a3b7-68e73bcd8e07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:28.769413 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37252f3-075e-4a41-a3b7-68e73bcd8e07 service neutron] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:28.774765 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:28.775360 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:28.775631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:28.775895 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] PATH_INFO: `/v3/projects/e7c2d0c2974f4c7a92131bd3f8eeb41c` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:28.777031 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c2d0c2974f4c7a92131bd3f8eeb41c)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:28.778934 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:28.873120 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:28.874355 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c2d0c2974f4c7a92131bd3f8eeb41c', 'request_id': 'req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:28.881109 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c2d0c2974f4c7a92131bd3f8eeb41c', 'request_id': 'req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:28.955276 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c2d0c2974f4c7a92131bd3f8eeb41c', 'request_id': 'req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:28.966717 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] The token cache is being invalidate because project e7c2d0c2974f4c7a92131bd3f8eeb41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:12:28.966938 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:28.967568 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-b50e1193-49fb-42c4-a9a2-3b0edab96ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:28.969188 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1428/2876] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:12:28 2022] DELETE /identity/v3/projects/e7c2d0c2974f4c7a92131bd3f8eeb41c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:28.974558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094fea-6deb-4923-80e9-0ba01d33c0d1 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:28.974843 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094fea-6deb-4923-80e9-0ba01d33c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:28.975111 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094fea-6deb-4923-80e9-0ba01d33c0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:28.994384 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1f094fea-6deb-4923-80e9-0ba01d33c0d1 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:28.995580 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1f094fea-6deb-4923-80e9-0ba01d33c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:29.054941 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:29.068625 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1449/2877] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:29.076345 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31c58-d95e-46d3-84da-a7d74333bcae None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:29.076613 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31c58-d95e-46d3-84da-a7d74333bcae None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:29.077418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31c58-d95e-46d3-84da-a7d74333bcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:29.097342 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-00d31c58-d95e-46d3-84da-a7d74333bcae None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:29.098804 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-00d31c58-d95e-46d3-84da-a7d74333bcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:29.106754 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1429/2878] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:12:29.110965 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f094fea-6deb-4923-80e9-0ba01d33c0d1 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:29.120970 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f094fea-6deb-4923-80e9-0ba01d33c0d1 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:29.125662 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a50b-5e0c-457b-b4f7-655533dc9318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:29.126253 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a50b-5e0c-457b-b4f7-655533dc9318 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:29.126536 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a50b-5e0c-457b-b4f7-655533dc9318 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:29.126807 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332a50b-5e0c-457b-b4f7-655533dc9318 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:29.127455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332a50b-5e0c-457b-b4f7-655533dc9318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:12:29.127801 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332a50b-5e0c-457b-b4f7-655533dc9318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:29.129935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332a50b-5e0c-457b-b4f7-655533dc9318 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:29.146052 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1450/2879] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:12:29.152389 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d31c58-d95e-46d3-84da-a7d74333bcae None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:29.156816 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d31c58-d95e-46d3-84da-a7d74333bcae None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:29.161460 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bc5e9-6f78-4c32-b715-89e883cce4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:29.162053 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bc5e9-6f78-4c32-b715-89e883cce4fc admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:29.162328 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bc5e9-6f78-4c32-b715-89e883cce4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:29.162594 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bc5e9-6f78-4c32-b715-89e883cce4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:29.163235 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bc5e9-6f78-4c32-b715-89e883cce4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:29.165172 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bc5e9-6f78-4c32-b715-89e883cce4fc admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:29.290910 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1430/2880] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:12:29 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:12:29.292122 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a50b-5e0c-457b-b4f7-655533dc9318 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:29.302595 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332a50b-5e0c-457b-b4f7-655533dc9318 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:29.361699 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63893f-4349-41b4-a686-2084e8e8334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:29.362366 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63893f-4349-41b4-a686-2084e8e8334c admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:29.362566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63893f-4349-41b4-a686-2084e8e8334c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:29.362838 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63893f-4349-41b4-a686-2084e8e8334c admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:29.363962 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63893f-4349-41b4-a686-2084e8e8334c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:29.365901 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63893f-4349-41b4-a686-2084e8e8334c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:29.459913 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1451/2881] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:12:29 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 23:12:29.464133 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bc5e9-6f78-4c32-b715-89e883cce4fc admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:29.474819 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bc5e9-6f78-4c32-b715-89e883cce4fc admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:29.479461 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c64d05-6511-4257-943f-00c66cce5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:29.480036 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c64d05-6511-4257-943f-00c66cce5018 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:29.480313 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c64d05-6511-4257-943f-00c66cce5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:29.480583 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c64d05-6511-4257-943f-00c66cce5018 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:29.481217 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c64d05-6511-4257-943f-00c66cce5018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:29.482830 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c64d05-6511-4257-943f-00c66cce5018 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:29.493223 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1431/2882] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:12:29.496964 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63893f-4349-41b4-a686-2084e8e8334c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:29.507459 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63893f-4349-41b4-a686-2084e8e8334c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:29.512234 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ac4a9-95dd-45b3-8824-d44d73ee6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:29.513385 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac4a9-95dd-45b3-8824-d44d73ee6370 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:29.513665 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac4a9-95dd-45b3-8824-d44d73ee6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:29.513935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac4a9-95dd-45b3-8824-d44d73ee6370 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:29.514567 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ac4a9-95dd-45b3-8824-d44d73ee6370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:29.516138 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ac4a9-95dd-45b3-8824-d44d73ee6370 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:29.527562 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1452/2883] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:12:29.531620 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c64d05-6511-4257-943f-00c66cce5018 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:29.541561 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c64d05-6511-4257-943f-00c66cce5018 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:29.546240 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda99757-5a1e-485f-a032-155a02d44006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:29.546886 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda99757-5a1e-485f-a032-155a02d44006 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:29.547163 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda99757-5a1e-485f-a032-155a02d44006 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:29.547436 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda99757-5a1e-485f-a032-155a02d44006 admin admin] PATH_INFO: `/v3/projects/b839855502d540dda6e9883c1467874c/users/2b6fa14cac354e35888e24b77a3e80e7/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:29.563125 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda99757-5a1e-485f-a032-155a02d44006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b839855502d540dda6e9883c1467874c, user_id=2b6fa14cac354e35888e24b77a3e80e7, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:29.565810 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda99757-5a1e-485f-a032-155a02d44006 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:29.644580 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1432/2884] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:12:29 2022] PUT /identity/v3/projects/b839855502d540dda6e9883c1467874c/users/2b6fa14cac354e35888e24b77a3e80e7/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:29.656498 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42520dca-0df1-4c38-9d9a-bcf80417dada None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:29.656782 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42520dca-0df1-4c38-9d9a-bcf80417dada None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:29.657050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42520dca-0df1-4c38-9d9a-bcf80417dada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:29.684929 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-42520dca-0df1-4c38-9d9a-bcf80417dada None None] MFA Rules not processed for user `2b6fa14cac354e35888e24b77a3e80e7`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:29.686173 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-42520dca-0df1-4c38-9d9a-bcf80417dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:29.749539 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1453/2885] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:29.762164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda99757-5a1e-485f-a032-155a02d44006 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:29.762164 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-bda99757-5a1e-485f-a032-155a02d44006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:29.818781 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda99757-5a1e-485f-a032-155a02d44006 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:29.822392 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecc124-43d7-4fe3-b6a2-f7e3b226f043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:29.822987 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecc124-43d7-4fe3-b6a2-f7e3b226f043 service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:29.823264 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecc124-43d7-4fe3-b6a2-f7e3b226f043 service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:29.823538 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecc124-43d7-4fe3-b6a2-f7e3b226f043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:29.831759 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecc124-43d7-4fe3-b6a2-f7e3b226f043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:29.833199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecc124-43d7-4fe3-b6a2-f7e3b226f043 service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:29.841948 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1433/2886] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:12:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:12:35.460918 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42520dca-0df1-4c38-9d9a-bcf80417dada None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:35.462426 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-42520dca-0df1-4c38-9d9a-bcf80417dada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:35.515922 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:35.531635 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42520dca-0df1-4c38-9d9a-bcf80417dada None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:35.536692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:35.537348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:35.537632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:35.537900 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] PATH_INFO: `/v3/users/1f0b384ac42043eabd486dd36eb02a79` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:35.539019 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0b384ac42043eabd486dd36eb02a79)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:35.540932 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:35.728568 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0b384ac42043eabd486dd36eb02a79'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:35.740863 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0b384ac42043eabd486dd36eb02a79'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:35.741581 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0b384ac42043eabd486dd36eb02a79'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:35.742211 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0b384ac42043eabd486dd36eb02a79'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:35.811585 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0b384ac42043eabd486dd36eb02a79'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:35.825179 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1454/2887] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:12:35 2022] DELETE /identity/v3/users/1f0b384ac42043eabd486dd36eb02a79 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:35.829695 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0e303-a000-4b44-a66b-797dc8f66ed7 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:35.830212 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0e303-a000-4b44-a66b-797dc8f66ed7 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:35.830398 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0e303-a000-4b44-a66b-797dc8f66ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:35.850267 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-b6b0e303-a000-4b44-a66b-797dc8f66ed7 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:35.852168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b6b0e303-a000-4b44-a66b-797dc8f66ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:35.913115 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1434/2888] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 23:12:35.922799 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:35.924178 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:35.982061 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792de59d-7ee5-4af0-8253-1e6aba977fc1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:35.985818 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b3b7f-cee4-41d8-82de-3b4c6bb5e489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:35.986396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b3b7f-cee4-41d8-82de-3b4c6bb5e489 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:35.986666 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b3b7f-cee4-41d8-82de-3b4c6bb5e489 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:35.986931 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b3b7f-cee4-41d8-82de-3b4c6bb5e489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:35.996558 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b3b7f-cee4-41d8-82de-3b4c6bb5e489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:35.998003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b3b7f-cee4-41d8-82de-3b4c6bb5e489 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:36.008159 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1455/2889] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:12:36.476592 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0e303-a000-4b44-a66b-797dc8f66ed7 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:36.478027 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-b6b0e303-a000-4b44-a66b-797dc8f66ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:36.510147 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0e303-a000-4b44-a66b-797dc8f66ed7 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:36.514351 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:36.515001 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:36.515277 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:36.515547 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] PATH_INFO: `/v3/projects/c41633408a774fa4abffb0a79a938679` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:36.516725 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41633408a774fa4abffb0a79a938679)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:36.518693 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:36.529749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:36.636380 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41633408a774fa4abffb0a79a938679', 'request_id': 'req-1e194121-3bde-474a-8f9e-cc8e3061a3a8'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:36.642994 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41633408a774fa4abffb0a79a938679', 'request_id': 'req-1e194121-3bde-474a-8f9e-cc8e3061a3a8'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:36.748508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41633408a774fa4abffb0a79a938679', 'request_id': 'req-1e194121-3bde-474a-8f9e-cc8e3061a3a8'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:36.763178 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] The token cache is being invalidate because project c41633408a774fa4abffb0a79a938679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:12:36.763469 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:36.764142 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-1e194121-3bde-474a-8f9e-cc8e3061a3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:36.765703 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1435/2890] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:12:36 2022] DELETE /identity/v3/projects/c41633408a774fa4abffb0a79a938679 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:36.772584 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2363b-2b86-4777-8a02-0cbeb2389f01 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:36.773151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2363b-2b86-4777-8a02-0cbeb2389f01 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:36.773331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2363b-2b86-4777-8a02-0cbeb2389f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:36.795632 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fed2363b-2b86-4777-8a02-0cbeb2389f01 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:36.797038 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fed2363b-2b86-4777-8a02-0cbeb2389f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:36.866318 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1456/2891] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:36.931344 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24d06c-46d0-4047-b8ed-ff9c98d2f6a2 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:36.931950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24d06c-46d0-4047-b8ed-ff9c98d2f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:36.931950 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24d06c-46d0-4047-b8ed-ff9c98d2f6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:36.951596 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-fd24d06c-46d0-4047-b8ed-ff9c98d2f6a2 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:36.952789 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-fd24d06c-46d0-4047-b8ed-ff9c98d2f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:36.965589 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1436/2892] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:36.969575 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2363b-2b86-4777-8a02-0cbeb2389f01 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:36.981636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2363b-2b86-4777-8a02-0cbeb2389f01 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:36.984882 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1250-c0d2-407f-a872-0e49fcb72929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:36.985616 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1250-c0d2-407f-a872-0e49fcb72929 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:36.985993 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1250-c0d2-407f-a872-0e49fcb72929 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:36.986362 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1250-c0d2-407f-a872-0e49fcb72929 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:36.987106 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda1250-c0d2-407f-a872-0e49fcb72929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 23:12:36.987416 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda1250-c0d2-407f-a872-0e49fcb72929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:36.989067 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda1250-c0d2-407f-a872-0e49fcb72929 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:36.995935 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:37.004428 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1457/2893] 10.222.0.77 () {58 vars in 1153 bytes} [Wed Aug 10 23:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 23:12:37.005508 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24d06c-46d0-4047-b8ed-ff9c98d2f6a2 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:37.015030 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24d06c-46d0-4047-b8ed-ff9c98d2f6a2 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:37.020419 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66768f-57c7-4d63-bb1b-e8f0aff9c1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:37.021035 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66768f-57c7-4d63-bb1b-e8f0aff9c1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:37.021317 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66768f-57c7-4d63-bb1b-e8f0aff9c1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:37.021709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66768f-57c7-4d63-bb1b-e8f0aff9c1b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:37.022273 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66768f-57c7-4d63-bb1b-e8f0aff9c1b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:37.024159 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66768f-57c7-4d63-bb1b-e8f0aff9c1b6 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:37.125105 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1437/2894] 10.222.0.77 () {60 vars in 1153 bytes} [Wed Aug 10 23:12:37 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:12:37.129822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1250-c0d2-407f-a872-0e49fcb72929 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:37.140287 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1250-c0d2-407f-a872-0e49fcb72929 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:37.197730 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dd57a-3faa-4aa1-a128-6ec145921f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:37.198321 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dd57a-3faa-4aa1-a128-6ec145921f0f admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:37.198593 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dd57a-3faa-4aa1-a128-6ec145921f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:37.198860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dd57a-3faa-4aa1-a128-6ec145921f0f admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:37.199466 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dd57a-3faa-4aa1-a128-6ec145921f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:37.201410 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dd57a-3faa-4aa1-a128-6ec145921f0f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:37.305331 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1458/2895] 10.222.0.77 () {60 vars in 1144 bytes} [Wed Aug 10 23:12:37 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 23:12:37.309504 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66768f-57c7-4d63-bb1b-e8f0aff9c1b6 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:37.321151 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66768f-57c7-4d63-bb1b-e8f0aff9c1b6 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:37.325835 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9ec85-f9bd-44db-bbb4-531760341486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:37.326438 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ec85-f9bd-44db-bbb4-531760341486 admin admin] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:37.326713 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ec85-f9bd-44db-bbb4-531760341486 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:37.326986 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9ec85-f9bd-44db-bbb4-531760341486 admin admin] PATH_INFO: `/v3/roles` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:37.327629 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9ec85-f9bd-44db-bbb4-531760341486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:37.329211 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9ec85-f9bd-44db-bbb4-531760341486 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:37.339862 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1438/2896] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 23:12:37.343952 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dd57a-3faa-4aa1-a128-6ec145921f0f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:37.354105 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dd57a-3faa-4aa1-a128-6ec145921f0f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:37.358660 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab7bf2-d20d-4354-a0bf-bae68ca25cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:37.359246 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab7bf2-d20d-4354-a0bf-bae68ca25cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:37.359522 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab7bf2-d20d-4354-a0bf-bae68ca25cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:37.359792 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab7bf2-d20d-4354-a0bf-bae68ca25cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:37.360424 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab7bf2-d20d-4354-a0bf-bae68ca25cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:37.362044 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab7bf2-d20d-4354-a0bf-bae68ca25cb4 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:37.377323 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1459/2897] 10.222.0.77 () {58 vars in 1122 bytes} [Wed Aug 10 23:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 23:12:37.380482 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9ec85-f9bd-44db-bbb4-531760341486 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:37.390418 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9ec85-f9bd-44db-bbb4-531760341486 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:37.395571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec42f6-2474-40d8-94c3-a1059c988f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:37.396205 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec42f6-2474-40d8-94c3-a1059c988f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:37.396481 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec42f6-2474-40d8-94c3-a1059c988f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:37.396749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec42f6-2474-40d8-94c3-a1059c988f47 admin admin] PATH_INFO: `/v3/projects/bfbfe94d6c1248d6b4ad2f50fcc0917b/users/ba800a1ad0844514b8050b48ad8a72a2/roles/ec8d0b12e5324b00bca50fea232c8690` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:37.415175 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec42f6-2474-40d8-94c3-a1059c988f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbfe94d6c1248d6b4ad2f50fcc0917b, user_id=ba800a1ad0844514b8050b48ad8a72a2, role_id=ec8d0b12e5324b00bca50fea232c8690)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:37.417861 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec42f6-2474-40d8-94c3-a1059c988f47 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:37.532307 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1439/2898] 10.222.0.77 () {60 vars in 1483 bytes} [Wed Aug 10 23:12:37 2022] PUT /identity/v3/projects/bfbfe94d6c1248d6b4ad2f50fcc0917b/users/ba800a1ad0844514b8050b48ad8a72a2/roles/ec8d0b12e5324b00bca50fea232c8690 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:37.542626 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103b440-a30c-4c4a-af90-21ac26396636 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:37.542866 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103b440-a30c-4c4a-af90-21ac26396636 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:37.543133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103b440-a30c-4c4a-af90-21ac26396636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:37.576814 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7103b440-a30c-4c4a-af90-21ac26396636 None None] MFA Rules not processed for user `ba800a1ad0844514b8050b48ad8a72a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:37.578038 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7103b440-a30c-4c4a-af90-21ac26396636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:37.645772 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1460/2899] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:37.656361 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec42f6-2474-40d8-94c3-a1059c988f47 admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:37.658168 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-87ec42f6-2474-40d8-94c3-a1059c988f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:37.716085 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec42f6-2474-40d8-94c3-a1059c988f47 admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:37.719847 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db6b39-32dd-4618-a161-6a234f4cb10e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3eca4101d5a74563855c7fa3dcf1ccc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:37.720437 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db6b39-32dd-4618-a161-6a234f4cb10e service cinder] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:37.720709 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db6b39-32dd-4618-a161-6a234f4cb10e service cinder] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:37.720971 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db6b39-32dd-4618-a161-6a234f4cb10e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:37.729918 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db6b39-32dd-4618-a161-6a234f4cb10e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:37.731318 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db6b39-32dd-4618-a161-6a234f4cb10e service cinder] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:37.739865 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1440/2900] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:12:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:12:41.498587 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103b440-a30c-4c4a-af90-21ac26396636 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:41.500011 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7103b440-a30c-4c4a-af90-21ac26396636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:41.565420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103b440-a30c-4c4a-af90-21ac26396636 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:41.570636 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:41.571251 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:41.571552 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:41.571824 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] PATH_INFO: `/v3/users/2b6fa14cac354e35888e24b77a3e80e7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:41.572926 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6fa14cac354e35888e24b77a3e80e7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:41.574944 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:41.580185 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:41.739822 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6fa14cac354e35888e24b77a3e80e7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:41.751503 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6fa14cac354e35888e24b77a3e80e7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:41.752170 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6fa14cac354e35888e24b77a3e80e7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:41.752774 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6fa14cac354e35888e24b77a3e80e7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:41.868779 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6fa14cac354e35888e24b77a3e80e7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:41.881201 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1461/2901] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:12:41 2022] DELETE /identity/v3/users/2b6fa14cac354e35888e24b77a3e80e7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:41.885696 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02713a03-12ba-48ea-afc3-bc8176dbbfea None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:41.886199 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02713a03-12ba-48ea-afc3-bc8176dbbfea None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:41.886298 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02713a03-12ba-48ea-afc3-bc8176dbbfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:41.904901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-02713a03-12ba-48ea-afc3-bc8176dbbfea None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:41.907499 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-02713a03-12ba-48ea-afc3-bc8176dbbfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:41.938543 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:41.964730 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1441/2902] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:41.975276 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:41.978168 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:42.033396 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf210e82-867b-431f-bfc7-3bb800a301a8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:42.037050 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259521a7-8a27-4da7-8f8a-be7e44152a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:42.037671 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259521a7-8a27-4da7-8f8a-be7e44152a37 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:42.037939 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259521a7-8a27-4da7-8f8a-be7e44152a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:42.038236 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259521a7-8a27-4da7-8f8a-be7e44152a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:42.047150 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259521a7-8a27-4da7-8f8a-be7e44152a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:42.048555 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259521a7-8a27-4da7-8f8a-be7e44152a37 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:42.058831 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1462/2903] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:12:42.461081 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02713a03-12ba-48ea-afc3-bc8176dbbfea None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:42.465441 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-02713a03-12ba-48ea-afc3-bc8176dbbfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:42.476095 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02713a03-12ba-48ea-afc3-bc8176dbbfea None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:42.480942 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:42.481742 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:42.481996 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:42.482264 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] PATH_INFO: `/v3/projects/b839855502d540dda6e9883c1467874c` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:42.483369 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b839855502d540dda6e9883c1467874c)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:42.485255 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:42.618513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b839855502d540dda6e9883c1467874c', 'request_id': 'req-44686a7e-94dd-432c-8acb-778360556304'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:42.624678 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b839855502d540dda6e9883c1467874c', 'request_id': 'req-44686a7e-94dd-432c-8acb-778360556304'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:42.697631 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b839855502d540dda6e9883c1467874c', 'request_id': 'req-44686a7e-94dd-432c-8acb-778360556304'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:42.710013 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] The token cache is being invalidate because project b839855502d540dda6e9883c1467874c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:12:42.710300 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:42.712048 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-44686a7e-94dd-432c-8acb-778360556304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:42.712610 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1442/2904] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:12:42 2022] DELETE /identity/v3/projects/b839855502d540dda6e9883c1467874c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:43.758166 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259521a7-8a27-4da7-8f8a-be7e44152a37 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:43.759540 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-259521a7-8a27-4da7-8f8a-be7e44152a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:43.772478 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259521a7-8a27-4da7-8f8a-be7e44152a37 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:43.827628 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:43.828180 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:43.828455 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:43.828724 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] PATH_INFO: `/v3/users/ba800a1ad0844514b8050b48ad8a72a2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:43.829861 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba800a1ad0844514b8050b48ad8a72a2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:43.832345 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:43.974113 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:43.983145 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba800a1ad0844514b8050b48ad8a72a2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:43.994487 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba800a1ad0844514b8050b48ad8a72a2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:43.995151 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba800a1ad0844514b8050b48ad8a72a2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:43.995758 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba800a1ad0844514b8050b48ad8a72a2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:44.077418 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba800a1ad0844514b8050b48ad8a72a2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:44.090643 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1463/2905] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:12:43 2022] DELETE /identity/v3/users/ba800a1ad0844514b8050b48ad8a72a2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:44.094993 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2423f-089c-4b88-8a74-e9b5aa420086 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:44.095493 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2423f-089c-4b88-8a74-e9b5aa420086 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:44.095600 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2423f-089c-4b88-8a74-e9b5aa420086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:44.114536 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-2df2423f-089c-4b88-8a74-e9b5aa420086 None None] MFA Rules not processed for user `8525de726b7c407fab4fe9cbff320061`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:12:44.115803 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2df2423f-089c-4b88-8a74-e9b5aa420086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:44.173470 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1443/2906] 10.222.0.77 () {58 vars in 958 bytes} [Wed Aug 10 23:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:12:44.183601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:44.184997 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:44.241229 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9749b-e73e-44c5-8046-7cf4111b1d6e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:44.244846 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170347a-2f3d-4622-a57e-ece424f1d560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff5c08bfc5e94b65bd4addde267e4598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:44.245473 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170347a-2f3d-4622-a57e-ece424f1d560 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:44.245752 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170347a-2f3d-4622-a57e-ece424f1d560 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:44.246024 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170347a-2f3d-4622-a57e-ece424f1d560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:44.255420 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170347a-2f3d-4622-a57e-ece424f1d560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:44.256837 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170347a-2f3d-4622-a57e-ece424f1d560 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:44.266100 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1464/2907] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:12:44.681864 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2423f-089c-4b88-8a74-e9b5aa420086 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:12:44.683338 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-2df2423f-089c-4b88-8a74-e9b5aa420086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:12:44.696137 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2423f-089c-4b88-8a74-e9b5aa420086 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:12:44.700925 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:12:44.701587 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:12:44.701916 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:12:44.702127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] PATH_INFO: `/v3/projects/bfbfe94d6c1248d6b4ad2f50fcc0917b` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:12:44.703237 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfbfe94d6c1248d6b4ad2f50fcc0917b)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:12:44.705128 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:12:44.854659 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbfe94d6c1248d6b4ad2f50fcc0917b', 'request_id': 'req-dc38810a-cb46-40e2-82c3-115662e9a850'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:44.860719 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbfe94d6c1248d6b4ad2f50fcc0917b', 'request_id': 'req-dc38810a-cb46-40e2-82c3-115662e9a850'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:44.863218 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:44.934700 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbfe94d6c1248d6b4ad2f50fcc0917b', 'request_id': 'req-dc38810a-cb46-40e2-82c3-115662e9a850'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:44.945868 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] The token cache is being invalidate because project bfbfe94d6c1248d6b4ad2f50fcc0917b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:12:44.946335 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:44.947472 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-dc38810a-cb46-40e2-82c3-115662e9a850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:12:44.949042 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1444/2908] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:12:44 2022] DELETE /identity/v3/projects/bfbfe94d6c1248d6b4ad2f50fcc0917b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:12:54.262008 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=44,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:55.022902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:DELETE=3,keystone:SELECT=4 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:36.030692 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170347a-2f3d-4622-a57e-ece424f1d560 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:13:36.032156 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e170347a-2f3d-4622-a57e-ece424f1d560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:13:36.099832 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170347a-2f3d-4622-a57e-ece424f1d560 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:13:36.155954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fd7ce-9fa2-4657-adf2-096367b20208 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:13:36.156853 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd7ce-9fa2-4657-adf2-096367b20208 service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:13:36.157133 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd7ce-9fa2-4657-adf2-096367b20208 service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:13:36.157431 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fd7ce-9fa2-4657-adf2-096367b20208 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:13:36.159103 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-607fd7ce-9fa2-4657-adf2-096367b20208 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:13:36.171018 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fd7ce-9fa2-4657-adf2-096367b20208 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:13:36.172570 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fd7ce-9fa2-4657-adf2-096367b20208 service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:13:36.182588 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1465/2909] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:13:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:13:37.918901 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5de40c-56cd-4eaa-934c-7adf1aac2584 None None] REQUEST_METHOD: `POST` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:13:37.919433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5de40c-56cd-4eaa-934c-7adf1aac2584 None None] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:13:37.919433 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5de40c-56cd-4eaa-934c-7adf1aac2584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:13:37.968724 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.auth.core [None req-8f5de40c-56cd-4eaa-934c-7adf1aac2584 None None] MFA Rules not processed for user `3500bd875ccf4a3c8302d0f6ce11c12b`. Rule list: `[]` (Enabled: `True`). {{(pid=93407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 23:13:37.969968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8f5de40c-56cd-4eaa-934c-7adf1aac2584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:13:38.033265 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1445/2910] 10.222.0.77 () {58 vars in 967 bytes} [Wed Aug 10 23:13:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 23:13:38.072598 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fd7ce-9fa2-4657-adf2-096367b20208 service placement] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:13:38.074049 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-607fd7ce-9fa2-4657-adf2-096367b20208 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:13:38.162506 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fd7ce-9fa2-4657-adf2-096367b20208 service placement] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:13:38.167419 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e9676-088d-4e8b-9c70-d95c622cd284 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c892a519c8348728d43f0f0d447a321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:13:38.168007 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e9676-088d-4e8b-9c70-d95c622cd284 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:13:38.168280 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e9676-088d-4e8b-9c70-d95c622cd284 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:13:38.168545 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e9676-088d-4e8b-9c70-d95c622cd284 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:13:38.176306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e9676-088d-4e8b-9c70-d95c622cd284 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:13:38.177888 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e9676-088d-4e8b-9c70-d95c622cd284 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:13:38.186187 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1466/2911] 10.222.0.77 () {60 vars in 1384 bytes} [Wed Aug 10 23:13:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 23:13:42.483033 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5de40c-56cd-4eaa-934c-7adf1aac2584 None None] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:13:42.484513 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-8f5de40c-56cd-4eaa-934c-7adf1aac2584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:13:42.499968 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5de40c-56cd-4eaa-934c-7adf1aac2584 None None] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:13:42.505902 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec055a5-2f7d-42c4-9117-0594c07db196 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:13:42.506749 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec055a5-2f7d-42c4-9117-0594c07db196 service placement] REQUEST_METHOD: `GET` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:13:42.507492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec055a5-2f7d-42c4-9117-0594c07db196 service placement] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:13:42.507492 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec055a5-2f7d-42c4-9117-0594c07db196 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:13:42.509100 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-4ec055a5-2f7d-42c4-9117-0594c07db196 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:13:42.520909 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec055a5-2f7d-42c4-9117-0594c07db196 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:13:42.522535 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec055a5-2f7d-42c4-9117-0594c07db196 service placement] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:13:42.532745 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1446/2912] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:13:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:13:46.158202 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e9676-088d-4e8b-9c70-d95c622cd284 service swift] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:13:46.159698 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-862e9676-088d-4e8b-9c70-d95c622cd284 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:13:46.166086 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:46.233371 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e9676-088d-4e8b-9c70-d95c622cd284 service swift] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:13:46.237927 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:13:46.238550 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:13:46.238883 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:13:46.239181 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] PATH_INFO: `/v3/users/caac71d5134e4bacbc2dc28baf0c984d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:13:46.240348 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caac71d5134e4bacbc2dc28baf0c984d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:13:46.242860 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:13:46.398941 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caac71d5134e4bacbc2dc28baf0c984d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:46.411306 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caac71d5134e4bacbc2dc28baf0c984d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:46.411960 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caac71d5134e4bacbc2dc28baf0c984d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:46.413165 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caac71d5134e4bacbc2dc28baf0c984d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:46.485486 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caac71d5134e4bacbc2dc28baf0c984d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:46.500954 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1467/2913] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:13:46 2022] DELETE /identity/v3/users/caac71d5134e4bacbc2dc28baf0c984d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:13:46.772354 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec055a5-2f7d-42c4-9117-0594c07db196 service placement] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:13:46.783812 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec055a5-2f7d-42c4-9117-0594c07db196 service placement] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:13:46.843966 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:13:46.844581 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:13:46.844856 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:13:46.845121 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] PATH_INFO: `/v3/projects/577a9a861a2a435c87115bbaa13f1c24` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:13:46.846258 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] RBAC: Authorizing `identity:delete_project(project_id=577a9a861a2a435c87115bbaa13f1c24)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:13:46.848127 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:13:46.947098 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577a9a861a2a435c87115bbaa13f1c24', 'request_id': 'req-ab254a35-45bb-48da-a49b-65722094256d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:46.953130 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577a9a861a2a435c87115bbaa13f1c24', 'request_id': 'req-ab254a35-45bb-48da-a49b-65722094256d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.039445 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577a9a861a2a435c87115bbaa13f1c24', 'request_id': 'req-ab254a35-45bb-48da-a49b-65722094256d'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.040820 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:47.050366 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] The token cache is being invalidate because project 577a9a861a2a435c87115bbaa13f1c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:13:47.050654 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.051271 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.052752 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1447/2914] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:13:46 2022] DELETE /identity/v3/projects/577a9a861a2a435c87115bbaa13f1c24 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:13:47.057250 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:13:47.058674 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:13:47.071610 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65618cf-0819-437e-8cd3-5169763fe961 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:13:47.127295 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654e12-0113-427c-a519-2df112483748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:13:47.127912 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654e12-0113-427c-a519-2df112483748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:13:47.128183 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654e12-0113-427c-a519-2df112483748 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:13:47.128501 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76654e12-0113-427c-a519-2df112483748 admin admin] PATH_INFO: `/v3/users/e7957b745a2540a88f3c2fc042ac43a5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:13:47.129688 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654e12-0113-427c-a519-2df112483748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7957b745a2540a88f3c2fc042ac43a5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:13:47.131566 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76654e12-0113-427c-a519-2df112483748 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:13:47.154961 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:47.332739 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-76654e12-0113-427c-a519-2df112483748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7957b745a2540a88f3c2fc042ac43a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.345157 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-76654e12-0113-427c-a519-2df112483748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7957b745a2540a88f3c2fc042ac43a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.345852 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-76654e12-0113-427c-a519-2df112483748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7957b745a2540a88f3c2fc042ac43a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.346457 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-76654e12-0113-427c-a519-2df112483748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7957b745a2540a88f3c2fc042ac43a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.444523 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-76654e12-0113-427c-a519-2df112483748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7957b745a2540a88f3c2fc042ac43a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.456708 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1468/2915] 10.222.0.77 () {58 vars in 1224 bytes} [Wed Aug 10 23:13:47 2022] DELETE /identity/v3/users/e7957b745a2540a88f3c2fc042ac43a5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:13:47.703577 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] Authenticating user token {{(pid=93407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:13:47.705015 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.fernet_utils [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:13:47.718311 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab254a35-45bb-48da-a49b-65722094256d admin admin] Validating token access rules against request {{(pid=93407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:13:47.775969 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8525de726b7c407fab4fe9cbff320061', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98ff4b51ad344f35909bb4fdee93bcd4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:13:47.776571 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:13:47.776842 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:13:47.777106 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] PATH_INFO: `/v3/projects/f837919961d54b61aebf1df5b51ecc87` {{(pid=93407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:13:47.778227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f837919961d54b61aebf1df5b51ecc87)` {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:13:47.780160 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] RBAC: Authorization granted {{(pid=93407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:13:47.889221 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f837919961d54b61aebf1df5b51ecc87', 'request_id': 'req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.895319 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f837919961d54b61aebf1df5b51ecc87', 'request_id': 'req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.982171 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f837919961d54b61aebf1df5b51ecc87', 'request_id': 'req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49'} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.993227 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] The token cache is being invalidate because project f837919961d54b61aebf1df5b51ecc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 23:13:47.993549 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.994159 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG keystone.notifications [None req-edd5f398-29a8-4ea0-bbf6-6b3f119e0b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 23:13:47.995647 dv-cinder-851449-5-smb devstack@keystone.service[93407]: [pid: 93407|app: 0|req: 1448/2916] 10.222.0.77 () {58 vars in 1233 bytes} [Wed Aug 10 23:13:47 2022] DELETE /identity/v3/projects/f837919961d54b61aebf1df5b51ecc87 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 23:13:57.467601 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=20,keystone:DELETE=6,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:57.989532 dv-cinder-851449-5-smb devstack@keystone.service[93407]: DEBUG dbcounter [-] [93407] Writing DB stats keystone:DELETE=9,keystone:SELECT=54,keystone:INSERT=1 {{(pid=93407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:38.483787 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654e12-0113-427c-a519-2df112483748 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 23:18:38.485182 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-76654e12-0113-427c-a519-2df112483748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:18:38.622003 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76654e12-0113-427c-a519-2df112483748 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 23:18:38.678421 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e67d57-e250-47e8-82d3-ffe56d61cd33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d9439b0577446f1ae9ff61a23df4143', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f235227ac853478b8621f61a6313a3e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 23:18:38.679015 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e67d57-e250-47e8-82d3-ffe56d61cd33 service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 23:18:38.679291 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e67d57-e250-47e8-82d3-ffe56d61cd33 service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 23:18:38.679560 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e67d57-e250-47e8-82d3-ffe56d61cd33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 23:18:38.681239 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-09e67d57-e250-47e8-82d3-ffe56d61cd33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 23:18:38.692214 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e67d57-e250-47e8-82d3-ffe56d61cd33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 23:18:38.693845 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e67d57-e250-47e8-82d3-ffe56d61cd33 service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 23:18:38.703525 dv-cinder-851449-5-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1469/2917] 10.222.0.77 () {60 vars in 1365 bytes} [Wed Aug 10 23:18:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 23:18:48.699346 dv-cinder-851449-5-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}